<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/">
  <channel>
    <title>information-theory on S Anand</title>
    <link>https://www.s-anand.net/blog/tag/information-theory/</link>
    <description>Recent content in information-theory on S Anand</description>
    <generator>Hugo -- 0.164.0</generator>
    <language>en-us</language>
    <lastBuildDate>Sun, 14 Jun 2026 00:00:00 +0000</lastBuildDate>
    <atom:link href="https://www.s-anand.net/blog/tag/information-theory/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Things I Learned - 14 Jun 2026</title>
      <link>https://www.s-anand.net/blog/things-i-learned-14-jun-2026/</link>
      <pubDate>Sun, 14 Jun 2026 00:00:00 +0000</pubDate>
      <guid>https://www.s-anand.net/blog/things-i-learned-14-jun-2026/</guid>
      <description>&lt;p&gt;This week, I learned:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Overheard a journalist saying: &amp;ldquo;I can tell when humans are lying. There are no tell tale signs of AI lying. At least &lt;em&gt;I&lt;/em&gt; don&amp;rsquo;t have any.&amp;rdquo;&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;https://github.com/public-clis/rdt-cli&#34;&gt;rdt-cli&lt;/a&gt; is a Reddit CLI. It uses a clever trick: it auto-detects installed browsers and extracts cookies (supports Chrome, Firefox, Edge, Brave). So, if you&amp;rsquo;re logged into Reddit on any browser, &lt;code&gt;uvx --from rdt-cli rdt whoami&lt;/code&gt; automatically shows who you are logged in as. (The &lt;a href=&#34;https://github.com/public-clis/public-clis&#34;&gt;public-clis&lt;/a&gt; repo also lists other useful CLIs like &lt;a href=&#34;https://github.com/public-clis/twitter-cli&#34;&gt;twitter-cli&lt;/a&gt;, )&lt;/li&gt;
&lt;li&gt;Currently, a $20 Claude Pro gives you ~$400 and a $100 Claude Max gives you ~$2,000 of API usage. For ChatGPT, the numbers are ~$700 and $3,500. &lt;a href=&#34;https://x.com/SemiAnalysis_/status/2064815044085318040&#34;&gt;SemiAnalysis&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;When Fable 5 refuses to answer questions, here&amp;rsquo;s the message that appears: &amp;ldquo;Fable 5 has safety measures that flag messages on most cybersecurity or biology topics. They may flag safe, normal content as well. These measures let us bring you Mythos-level capability in other areas sooner, and we&amp;rsquo;re working to refine them. Send feedback or &lt;a href=&#34;https://support.claude.com/en/articles/15363606&#34;&gt;learn more&lt;/a&gt;.&amp;rdquo; I managed to trigger this once while researching an M&amp;amp;A acquisition target. Clicking on &amp;ldquo;Edit and retry with Fable 5&amp;rdquo; triggered Opus 5 again, twice.&lt;/li&gt;
&lt;li&gt;DNA codons (A, T, C, G) encode proteins in triplets. There are &lt;a href=&#34;https://en.wikipedia.org/wiki/DNA_and_RNA_codon_tables&#34;&gt;64 triplets that map to 20 amino acids&lt;/a&gt;. Some like Leucine, have 6 codons. Some like Methionine have only one. Why? When creating genes, there&amp;rsquo;s a wobble, sometimes, at the 3rd codon. THe mapping minimizes that impact: small errors map to similar proteins. The more common proteins have more codons. There&amp;rsquo;s a lot of fascinating information science going on here. &lt;a href=&#34;https://gemini.google.com/share/cfa70dcab30c&#34;&gt;Gemini&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;ChatGPT now shows a &amp;ldquo;Check in&amp;rdquo; button when it&amp;rsquo;s thinking. Clicking on that gives you a work-in-progress answer while it continues thinking. When done, it &lt;em&gt;replaces&lt;/em&gt; the WIP answer with the final answer. A useful feature!&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id=&#34;questions-i-was-asked&#34;&gt;Questions I was asked&lt;/h2&gt;
&lt;p&gt;&lt;a href=&#34;https://www.s-anand.net/blog/questions-i-am-asked/#week-ending-2026-06-14&#34;&gt;Week ending 14 Jun 2026&lt;/a&gt;&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should we verify that an AI/download tool captured all files?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Use another chat as an independent checker and ask “what is missing?” Don’t ask “does it match?” because that invites lazy confirmation.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What prompt helps convert data into a shareable dashboard?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Ask for a single-page HTML file. It gives you something portable, inspectable, and easy to email or publish.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should audience feedback be used in AI-generated data stories?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Dump the feedback back into the model. Since generation and verification are cheap, the scarce skill shifts to collecting, interpreting, and iterating on feedback.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How do we stop AI data-story sessions from becoming repetitive loops?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Start a new chat, switch model or provider, or meta-prompt: give the failed conversation to AI and ask it how to make the next prompt more novel.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: If AI keeps refining answers, do humans stop learning?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: The new skill is steering smarter intelligences. Editors, judges, auditors, teachers, and coaches already guide work they cannot fully reproduce.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: When should humans verify AI analysis?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Treat AI like a fresh journalist. Check heavily at first, stratify by risk, build confidence, delegate some verification, and periodically test for regression.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: Is a paid AI subscription worth it for occasional users?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Buy Plus for one month and use it hard. If it is paisa vasool, continue; if not, cancel and retry in six months because the frontier moves fast.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How do Chinese LLMs compare with frontier models?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Use them when cost matters at scale. They are good and cheap, but frontier models still lead; default to frontier unless economics force optimization.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What can AI add to geospatial storytelling?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: It can scan satellite grids for change and surface story leads. But indices create false positives, so visual inspection and narrative judgment still matter.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: After AI identifies bottlenecks and recommended actions, what is missing before sending it to leadership?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Add monetizable business benefit, estimated impact, and evidence for that impact. Process benefit is your problem; business benefit is what buys attention.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: Which coding agent should we recommend when a fresh client has no preference?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Default to the client’s cloud provider: Gemini for Google, GitHub Copilot for Microsoft, OpenAI or Anthropic if they already prefer them.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What should students do when ATS filters reject qualified resumes?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Hack the system and publish the hack. ATS is another machine-mediated system; learn how it fails and use that knowledge.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should agents organize unstructured folders for repeated future questions?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Tell the agent many questions are coming and ask it to design the organization: summaries, entities, intents, tags, and evidence. Let the semantic layer emerge from usage.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: When does a knowledge graph make sense for enterprise documents?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: When relationships matter: clauses, asset classes, customer segments, obligations, exceptions. The graph captures institutional checklists that humans otherwise carry in their heads.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should we calm leaders who think data must be fully cleaned before agents can use it?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Tell them it may not be as hard as they think. Let agents try inside their system; the downside is small and the learning is immediate.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should an AI/data-viz dialogue be structured so it stays participatory?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Plan the mechanics, takeaways, and sequence, but order everything by droppability. Use audience volunteers and leave room for improvisation.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should we choose charts for an AI-vs-human visualization exercise?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Use embeddings or UMAP to pick a diverse set, then create paired AI-generated alternatives. Don’t pick naïvely; use the corpus to sample the space.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: Is the real question whether people can detect AI charts?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: No. The first question is what makes a chart good. The AI reveal is secondary: does knowing the source change how people judge quality?&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What is the right unit for comparing AI and human visualization work?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Data visualization, not chart mechanics. The hard parts are topic selection, insight choice, framing, and presentation, not whether D3 was written by hand.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What is the practical skill people need as AI makes more charts?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Curation. People need explicit, communicable judgment about what is useful, truthful, beautiful, and worth publishing, whether the maker is human or AI.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should educators deal with students copy-pasting into ChatGPT?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Don’t teach what ChatGPT can already do. Teach what it cannot do, then evaluate both foundational understanding and AI-enabled execution.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should we test whether AI can help with patient-specific implants and CAD?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Don’t start with the full clinical workflow. Give AI a basic tool task: create a mesh, create a fitting patch, get feedback, then iterate.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should we use AI for hard research problems like moving-boundary FEM?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Don’t ask it for the final answer. Ask it to ideate, mock the physics, test multiple approaches, show evidence, and make the researcher smarter.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should we evaluate students in an AI-enabled course?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Simulate industry: give 10x workload, allow AI and collaboration, grade outcomes, and remove questions once the batch collectively learns the pattern.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should an AI services startup think about pricing when software is depreciating?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Discount the commodity extraction and charge for verification and value-add. Find the money leaks from the first batch, then price against savings or outcome.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: Are demos now the right way to pitch?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Yes, if the demo solves their specific domain problem with their data or public data. Generic code demos impress the middle; evidence-backed recommendations impress sophisticated buyers.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What does productionization look like when the coding agent is the production software?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Productionization becomes delivering real paid output through a process, not deploying an app. SME plus coding agent plus review loop can itself be the production system.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: Doesn’t TDD work better for production software?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Yes, if you’re delivering software. But if you’re delivering the output software would produce, test the output and system benchmarks, not just the code.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: For an IDP platform, what should delivery look like if not software handover?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Sell the extracted XML, JSON, or results from day one with human-on-the-loop review. Zero CAPEX, zero lead time, lower TCO.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should we judge hallucinating models?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Compare them to people, not perfect machines. Subject matter experts disagree and err too; if a pocket PhD hallucinates, the question is what it enables with review.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: If humans ask us to ask ChatGPT for them, is that valuable?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Yes. You are not just entering the prompt; you are the evaluator and filter. “Human as interface” may be monetizable when trust and judgment are scarce.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should we use non-frontier or local models?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Use a task checklist of what models currently cannot do. Benchmark model-task fit, not generic intelligence; local models may be good enough for narrow extraction or graph work.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How do we convert a personal Co-work audit checklist into firm-wide agents?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Export the best representative conversations with inputs, outputs, and prompts. From those, create reusable agents for financial-statement review, audit-report checks, and other audit workflows.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should we respond when a client worries our custom AI solution is not SaaS and will be hard to maintain?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Don’t defend point-by-point. Say they’re right, revise the positioning, and offer Solution-as-a-Service: the outcome and maintenance headache are ours.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What is the expected FDE output format?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: An email to a real person: “Please do this because of this reason, and here is the evidence.” One use case is fine; many solved use cases are better.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What if the client gave only partial data and our recommendation misses context?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: State the boundary: “Based on the data I have&amp;hellip;” Add what context may be missing. If they provide more data, rerun; otherwise move to the next useful use case.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: Can we use generic or synthetic data for a problem from the spreadsheet?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Yes, but anchor it to a real human who would benefit from a real action. Synthetic data is acceptable only when the recommendation is still useful and honest.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What do you actually teach in Tools in Data Science now?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Not data science, really. I teach how to use AI to do data science and pass tasks by hook or by crook.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How can AI use rich student reflection, game, and story material?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Use it for concept-space mapping: clusters, outliers, negative space, and unusual student thinking. It can reveal how students think, not just grade them.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should Engineering Design explore AI?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Start with verifiable environments. Connect AI to CAD, simulation, FEM, SPICE, MuJoCo, or Blender so it creates outputs, gets tool feedback, and iterates.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: Is ChatGPT better at math or literal work than Claude?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: For literal instruction-following, yes. ChatGPT treats “all” like “do not miss anything”; Claude often treats it more casually.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What can I do with 25 years of curated fraud, health, and technology articles now that AI can search?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Start with what AI can do, then use your archive and judgment to add the missing 10–20%. Use AI to surface, triage, and direct.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What happens after AI can generate everything quickly?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: The bottleneck shifts. First verification becomes the constraint, then deciding what to do with the flood of outputs, then the work AI still cannot do piles up.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should a large organization manage AI infra and token cost?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Meter visibly from day one. Give small default budgets, publish usage, raise limits by project/P&amp;amp;L, and make owners own direct costs.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: If clients ask us to re-estimate because Claude reduces effort, how do we respond?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Reposition from effort to accountable outcome. Clients still pay for ownership, assurance, and “catch us if it goes wrong,” not just the report or code.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: If an agent is like an employee, how do we onboard it?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Ask AI to read existing training material and create its induction guide. Give it an email ID, manager, examples, rules, and feedback like a new hire.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should we think about prompt-only 3D/product design workflows?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Use an agent-tool loop. Claude Code connected to Blender through MCP can create 3D output with no bespoke software, just prompting, verification, and iteration.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: Who can become a forward deployed engineer inside a client environment?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Anyone with client data access, AI access, initiative, and curiosity. The job is not to pitch projects; it is to solve problems and send actionable outputs.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should we make HR, Finance, and Travel look AI-native internally?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Run demand-generating sessions on what current AI tools can already do. Pull transformation from real functional pain instead of pushing generic AI from the center.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What is the real training gap in enterprise AI platforms?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Often it is initiative, not education. People wait for step-by-step internal-platform training instead of finding docs, people, and workarounds themselves.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How should we hire or filter FDEs?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Test attitude first. Did they solve real problems outside curriculum, learn on their own, and push through bad documentation? Then test communication, engineering judgment, and explanation.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: Do freshers work as FDEs?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Sometimes, but they often vibe-code blindly. Experience matters for judging architecture, explaining trade-offs, communicating status, and navigating ambiguity.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: Should data strategy wait for a cleaned data lake before agents?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: No. Agents can clean, script, structure, and improve data on the fly. Data strategy should start from what agents need and do, not a parallel lake-cleanup program.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How do we make AI assumptions memorable for leaders?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Show their own assumption crumbling live. If they think a report takes a week, have AI make a draft in eight minutes and ask what it would have cost.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: Where should we look for horizontal AI disruption ideas?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Visual AI. Anything that produces engineering drawings, 3D models, architecture, circuits, or design artifacts is ripe because code-like outputs are verifiable.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: How do we quickly create an AI workshop brochure for CXOs?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: Use my talks page and LLM blog posts as source material. Ask Claude or ChatGPT to tailor the poster or PDF to the audience, theme, and call-to-action.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Question&lt;/strong&gt;: What does “LLM Psychologist” mean?&lt;br&gt;
&lt;strong&gt;Answer&lt;/strong&gt;: It means studying how models behave under different prompts. Same model, different inputs; same input, different models; understand how to talk to them effectively.&lt;/li&gt;
&lt;/ul&gt;
</description>
    </item>
    <item>
      <title>Classic texts in computer science</title>
      <link>https://www.s-anand.net/blog/classic-texts-in-computer-science/</link>
      <pubDate>Wed, 21 Jun 2006 12:00:00 +0000</pubDate>
      <guid>https://www.s-anand.net/blog/classic-texts-in-computer-science/</guid>
      <description>&lt;p&gt;&lt;a href=&#34;http://www.zafar.se/bkz/wiki/view/43bafac8c8570f4f&#34;&gt;Classic texts in computer science&lt;/a&gt;. Worth reading for the sheer insight.&lt;/p&gt;
&lt;p&gt;Update: The link didn&amp;rsquo;t seem to work in Feb 2007. Here&amp;rsquo;s the list.&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;a href=&#34;http://www.spatial.maine.edu/~worboys/processes/hoare%20axiomatic.pdf&#34;&gt;An axiomatic basis for computer programming&lt;/a&gt; by C. A. R. Hoare&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.usingcsp.com/&#34;&gt;Communicating Sequential Processes (CSP)&lt;/a&gt; by C. A. R. Hoare&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://homepages.inf.ed.ac.uk/gdp/publications/cbn_cbv_lambda.pdf&#34;&gt;Call-by-name, call-by-value, and the lambda calculus&lt;/a&gt; by Gordon Plotkin&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;ftp://ftp.cs.cmu.edu/user/jcr/theotypestr.pdf&#34;&gt;Towards a theory of type structure&lt;/a&gt; by John C. Reynolds&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;ftp://ftp.cs.cmu.edu/user/jcr/defint.ps.gz&#34;&gt;Definitional interpreters for higher-order programming languages&lt;/a&gt; by John C. Reynolds&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.slac.stanford.edu/pubs/slacreports/slac-r-114.html&#34;&gt;An APL Machine 1970&lt;/a&gt; by Philip S. Abrams&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.pipeline.com/~hbaker1/&#34;&gt;Henry Baker&amp;rsquo;s Archive of Research Papers (many classic Lisp papers)&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www-db.stanford.edu/pub/papers/google.pdf&#34;&gt;The Anatomy of a Large-Scale Hypertextual Web Search Engin&lt;/a&gt; by Sergey Brin and Lawrence Page&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www-inst.eecs.berkeley.edu/~maratb/readings/NoSilverBullet.html&#34;&gt;No Silver Bullet: Essence and Accidents of Software Engineering&lt;/a&gt; by Frederic P. Brooks, Jr.&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.unil.ch/webdav/site/ling/shared/ElementStatText/Shannon1948.pdf&#34;&gt;A Mathematical Theory of Communication&lt;/a&gt; by Claude Shannon&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.cs.ucla.edu/~jkong/research/security/shannon1949.pdf&#34;&gt;Communication Theory of Secrecy Systems&lt;/a&gt; by Claude Shannon&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.cs.ubc.ca/~murphyk/Bayes/Charniak_91.pdf&#34;&gt;Bayesian Networks without Tears&lt;/a&gt; by Eugene Charniak&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.stanford.edu/class/ee398a/resources/ziv:77-SDC.pdf&#34;&gt;A Universal Algorithm for Sequential Data Compression&lt;/a&gt; by Jacob Ziv and Abraham Lempel&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.cs.duke.edu/~junyang/cps216/papers/codd-1970.pdf&#34;&gt;A Relational Model of Data for Large Shared Data Banks 1970&lt;/a&gt; by Edgar F. Codd&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://compilers.iecc.com/crenshaw/&#34;&gt;Let&amp;rsquo;s Build a Compiler 1988-1995&lt;/a&gt; by Jack Crenshaw&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://gnowledge.sourceforge.net/damashek-ngrams.pdf&#34;&gt;Gauging Similarity via N-Grams: Language-Independent Sorting, Categorization, and Retrieval of Text&lt;/a&gt; by Marc Damashek&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.dreamsongs.com/WorseIsBetter.html&#34;&gt;Worse Is Better&lt;/a&gt; by Richard P. Gabriel&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.cs.berkeley.edu/~necula/cs263/handouts/hoarehints.pdf&#34;&gt;Hints on Programming Language Design&lt;/a&gt; by C.A.R. Hoare&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.math.chalmers.se/~rjmh/Papers/whyfp.pdf&#34;&gt;Why Functional Programming Matters&lt;/a&gt; by John Hughes&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.research.ibm.com/journal/rd/174/ibmrd1704F.pdf&#34;&gt;The Design of APL&lt;/a&gt; by Kenneth E. Iverson&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.metaobject.com/papers/Smallhistory.pdf&#34;&gt;The Early History Of Smalltalk&lt;/a&gt; by Alan Kay&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://fresh.homeunix.net/~luke/misc/knuth-turingaward.pdf&#34;&gt;Computer Programming as an Art&lt;/a&gt; by Donald E. Knuth&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.cs.utah.edu/~wilson/compilers/old/papers/p157-landin.pdf&#34;&gt;The next 700 programming languages&lt;/a&gt; by Peter J. Landin&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www-formal.stanford.edu/jmc/recursive.html&#34;&gt;Recursive Functions of Symbolic Expressions and their Computation by Machine (Part I) 1960&lt;/a&gt; by John McCarthy&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.cs.wisc.edu/~bolo/shipyard/4th_1970/4th_1970.html&#34;&gt;FORTH - A Language for Interactive Computing&lt;/a&gt; by Charles H.Moore&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.norvig.com/21-days.html&#34;&gt;Teach Yourself Programming in Ten Years 2001&lt;/a&gt; by Peter Norvig&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.nhplace.com/kent/PS/About-PS.html&#34;&gt;Parenthetically Speaking, a collection of essays from the 1990s&lt;/a&gt; by Kent M. Pitman&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;ftp://publications.ai.mit.edu/ai-publications/500-999/AITR-595.ps&#34;&gt;The Definition and Implementation of a Computer Language based on constraints&lt;/a&gt; by Guy Lewis Steele Jr.&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.cs.umbc.edu/331/resources/papers/gls-grow-lang.pdf&#34;&gt;Growing a Language&lt;/a&gt; by Guy Lewis Steele Jr.&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www-pu.informatik.uni-tuebingen.de/users/klaeren/epigrams.html&#34;&gt;Epigrams on Programming&lt;/a&gt; by Alan J. Perlis&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://www.cs.helsinki.fi/u/gionis/cc05/cook.pdf&#34;&gt;The Complexity of Theorem Proving Procedures&lt;/a&gt; by Stephen A. Cook&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://web.media.mit.edu/~minsky/papers/steps.html&#34;&gt;Steps Toward Artificial Intelligence&lt;/a&gt; by Marvin Minsky&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://library.readscheme.org/page1.html&#34;&gt;The Original &amp;lsquo;Lambda Papers&amp;rsquo;&lt;/a&gt; by Guy Steele and Gerald Sussman&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://theory.lcs.mit.edu/~rivest/rsapaper.pdf&#34;&gt;A Method for Obtaining Digital Signatures and Public-Key Cryptosystems&lt;/a&gt; by R.L. Rivest, A. Shamir, and L. Adleman&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;http://cm.bell-labs.com/cm/cs/who/dmr/cacm.html&#34;&gt;The UNIX Time-Sharing System&lt;/a&gt; by Dennis Ritchie and Ken Thompson&lt;/li&gt;
&lt;/ul&gt;
&lt;hr&gt;
&lt;h2 id=&#34;comments&#34;&gt;Comments&lt;/h2&gt;
&lt;!-- wp-comments-start --&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;jawahar&lt;/strong&gt; &lt;em&gt;6 Feb 2007 5:52 am&lt;/em&gt;:
anand this link is not working !!&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;&lt;a href=&#34;https://maxviv.wordpress.com/2016/06/05/classic-texts-in-computer-science/&#34;&gt;Classic-texts-in-computer-science – maxviv&lt;/a&gt;&lt;/strong&gt; &lt;em&gt;5 Jun 2016 7:15 pm&lt;/em&gt; &lt;em&gt;(pingback)&lt;/em&gt;:
[…] Classic texts in computer science […]&lt;/li&gt;
&lt;/ul&gt;
&lt;!-- wp-comments-end --&gt;
</description>
    </item>
    <item>
      <title>Better information is not always beneficial</title>
      <link>https://www.s-anand.net/blog/better-information-is-not-always-beneficial/</link>
      <pubDate>Sat, 24 Sep 2005 12:00:00 +0000</pubDate>
      <guid>https://www.s-anand.net/blog/better-information-is-not-always-beneficial/</guid>
      <description>&lt;p&gt;&lt;a href=&#34;http://online.wsj.com/public/article/0,,SB112734060508547844-4Gx7dIqhluIyFxPiOh2mkB8mXrY_20060922,00.html?mod=blog&#34;&gt;Better information is not always beneficial&lt;/a&gt;.&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;For $795, LegalMetric LLC will tell you which judges rule most swiftly and which tend to favor patent holders. For lawyer and client, this knowledge can be very valuable. But does it increase the chances that the judge will come to a just decision?&lt;/p&gt;
&lt;p&gt;It is the sort of information that Nobel laureate Kenneth Arrow labeled &amp;ldquo;socially useless but privately valuable.&amp;rdquo; It doesn&amp;rsquo;t help the economy produce more goods or services. It creates nothing of beauty or pleasure. It simply helps someone get a bigger slice of the pie. Sure, if the product helps win cases, then both sides will buy it &amp;ndash; just as both sides in high-stakes product-liability cases invest in jury-selection experts and software &amp;ndash; and neither will have an unfair advantage. But does that make the society better off?&lt;/p&gt;
&lt;/blockquote&gt;
&lt;hr&gt;
&lt;h2 id=&#34;comments&#34;&gt;Comments&lt;/h2&gt;
&lt;!-- wp-comments-start --&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Arun&lt;/strong&gt; &lt;em&gt;24 Sep 2005 4:51 pm&lt;/em&gt;:
Interesting article. An internet bubble qualifies too, i presume? :-)&lt;/li&gt;
&lt;/ul&gt;
&lt;!-- wp-comments-end --&gt;
</description>
    </item>
    <item>
      <title>Limits of computing power</title>
      <link>https://www.s-anand.net/blog/limits-of-computing-power/</link>
      <pubDate>Wed, 04 Jul 2001 12:00:00 +0000</pubDate>
      <guid>https://www.s-anand.net/blog/limits-of-computing-power/</guid>
      <description>&lt;p&gt;A bizzarre calculation on the &lt;a href=&#34;http://arstechnica.com/wankerdesk/01q2/limits/limits-1.html&#34;&gt;limits of computing power&lt;/a&gt; using fundamentals of quantum mechanics.&lt;/p&gt;
</description>
    </item>
    <item>
      <title>Worlds information growth</title>
      <link>https://www.s-anand.net/blog/worlds-information-growth/</link>
      <pubDate>Wed, 01 Nov 2000 12:00:00 +0000</pubDate>
      <guid>https://www.s-anand.net/blog/worlds-information-growth/</guid>
      <description>&lt;p&gt;A &lt;a href=&#34;http://www.sims.berkeley.edu/how-much-info/&#34;&gt;study&lt;/a&gt; shows that the world is producing about 250MB of info per person per year. It means that, on average, &lt;strong&gt;each of us&lt;/strong&gt; is writing 50 times the size of the complete works of Shakespeare &lt;strong&gt;every year&lt;/strong&gt;! If you&amp;rsquo;re wondering how that&amp;rsquo;s possible, just wander around this web page :-)&lt;/p&gt;
</description>
    </item>
  </channel>
</rss>
