<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/">
  <channel>
    <title>data-mining on S Anand</title>
    <link>https://www.s-anand.net/blog/tag/data-mining/</link>
    <description>Recent content in data-mining on S Anand</description>
    <generator>Hugo -- 0.156.0</generator>
    <language>en-us</language>
    <lastBuildDate>Tue, 26 May 2026 22:20:17 +0800</lastBuildDate>
    <atom:link href="https://www.s-anand.net/blog/tag/data-mining/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Longest repeated paragraph on Wikipedia</title>
      <link>https://www.s-anand.net/blog/longest-repeated-paragraph-on-wikipedia/</link>
      <pubDate>Tue, 26 May 2026 22:20:17 +0800</pubDate>
      <guid>https://www.s-anand.net/blog/longest-repeated-paragraph-on-wikipedia/</guid>
      <description>&lt;p&gt;What is the most frequently occurring sentence in Wikipedia? ANS: A 213-word paragraph about &lt;a href=&#34;https://en.wikipedia.org/wiki/Meanings_of_minor-planet_names&#34;&gt;how minor planets are named&lt;/a&gt;, which appears in 418 Wikipedia articles, word-for-word!&lt;/p&gt;
&lt;p&gt;There are ~380,000 asteroids. Wikipedia has 418 pages for these - including one for each thousand-range of asteroids.&lt;/p&gt;
&lt;p&gt;Every single one of these pages includes the phrase:&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;As &lt;a href=&#34;https://en.wikipedia.org/wiki/Minor%5Fplanet&#34; title=&#34;Minor planet&#34;&gt;minor planet&lt;/a&gt; discoveries are confirmed, they are given a permanent number by the &lt;a href=&#34;https://en.wikipedia.org/wiki/International%5FAstronomical%5FUnion&#34; title=&#34;International Astronomical Union&#34;&gt;IAU&lt;/a&gt;&amp;rsquo;s &lt;a href=&#34;https://en.wikipedia.org/wiki/Minor%5FPlanet%5FCenter&#34; title=&#34;Minor Planet Center&#34;&gt;Minor Planet Center&lt;/a&gt; (MPC), and the discoverers can then submit names for them, following the IAU&amp;rsquo;s &lt;a href=&#34;https://en.wikipedia.org/wiki/Astronomical%5Fnaming%5Fconventions&#34; title=&#34;Astronomical naming conventions&#34;&gt;naming conventions&lt;/a&gt;. The list below concerns those minor planets in the specified number-range that have received names, and explains the meanings of those names.&lt;/p&gt;
&lt;p&gt;Official naming citations of newly named &lt;a href=&#34;https://en.wikipedia.org/wiki/Small%5FSolar%5FSystem%5Fbodies&#34; title=&#34;Small Solar System bodies&#34;&gt;small Solar System bodies&lt;/a&gt; are approved and published in a bulletin by IAU&amp;rsquo;s &lt;a href=&#34;https://en.wikipedia.org/wiki/Working%5FGroup%5Ffor%5FSmall%5FBodies%5FNomenclature&#34; title=&#34;Working Group for Small Bodies Nomenclature&#34;&gt;Working Group for Small Bodies Nomenclature&lt;/a&gt; (WGSBN).&lt;a href=&#34;https://en.wikipedia.org/wiki/Meanings%5Fof%5Fminor-planet%5Fnames:%5F213001%E2%80%93214000#cite%5Fnote-WGSBN-Bulletin-Archive-1&#34;&gt;[1]&lt;/a&gt; Before May 2021, citations were published in MPC&amp;rsquo;s &lt;em&gt;&lt;a href=&#34;https://en.wikipedia.org/wiki/Minor%5FPlanet%5FCirculars&#34; title=&#34;Minor Planet Circulars&#34;&gt;Minor Planet Circulars&lt;/a&gt;&lt;/em&gt; for many decades.&lt;a href=&#34;https://en.wikipedia.org/wiki/Meanings%5Fof%5Fminor-planet%5Fnames:%5F213001%E2%80%93214000#cite%5Fnote-MPC-Circulars-Archive-2&#34;&gt;[2]&lt;/a&gt; Recent citations can also be found on the &lt;a href=&#34;https://en.wikipedia.org/wiki/JPL%5FSmall-Body%5FDatabase&#34; title=&#34;JPL Small-Body Database&#34;&gt;JPL Small-Body Database&lt;/a&gt; (SBDB).&lt;a href=&#34;https://en.wikipedia.org/wiki/Meanings%5Fof%5Fminor-planet%5Fnames:%5F213001%E2%80%93214000#cite%5Fnote-JPL-Discovery-3&#34;&gt;[3]&lt;/a&gt; Until his death in 2016, German astronomer &lt;a href=&#34;https://en.wikipedia.org/wiki/Lutz%5FD.%5FSchmadel&#34; title=&#34;Lutz D. Schmadel&#34;&gt;Lutz D. Schmadel&lt;/a&gt; compiled these citations into the &lt;em&gt;Dictionary of Minor Planet Names&lt;/em&gt; (DMP) and regularly updated the collection.&lt;a href=&#34;https://en.wikipedia.org/wiki/Meanings%5Fof%5Fminor-planet%5Fnames:%5F213001%E2%80%93214000#cite%5Fnote-DoMPN-4&#34;&gt;[4]&lt;/a&gt;&lt;a href=&#34;https://en.wikipedia.org/wiki/Meanings%5Fof%5Fminor-planet%5Fnames:%5F213001%E2%80%93214000#cite%5Fnote-DoMPN-Addendum-5&#34;&gt;[5]&lt;/a&gt;&lt;/p&gt;
&lt;p&gt;Based on &lt;a href=&#34;https://en.wikipedia.org/wiki/Paul%5FHerget&#34; title=&#34;Paul Herget&#34;&gt;Paul Herget&lt;/a&gt;&amp;rsquo;s &lt;em&gt;&lt;a href=&#34;https://en.wikipedia.org/wiki/The%5FNames%5Fof%5Fthe%5FMinor%5FPlanets&#34; title=&#34;The Names of the Minor Planets&#34;&gt;The Names of the Minor Planets&lt;/a&gt;&lt;/em&gt;,&lt;a href=&#34;https://en.wikipedia.org/wiki/Meanings%5Fof%5Fminor-planet%5Fnames:%5F213001%E2%80%93214000#cite%5Fnote-Herget-6&#34;&gt;[6]&lt;/a&gt; Schmadel also researched the unclear origin of numerous asteroids, most of which had been named prior to World War II.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;Check out these pages
| &lt;a href=&#34;https://en.wikipedia.org/wiki/Meanings_of_minor-planet_names:_85001%E2%80%9386000&#34;&gt;85001-86000&lt;/a&gt;
| &lt;a href=&#34;https://en.wikipedia.org/wiki/Meanings_of_minor-planet_names:_213001%E2%80%93214000&#34;&gt;213001-214000&lt;/a&gt;
| &lt;a href=&#34;https://en.wikipedia.org/wiki/Meanings_of_minor-planet_names:_269001%E2%80%93270000&#34;&gt;269001-270000&lt;/a&gt;
| &lt;a href=&#34;https://en.wikipedia.org/wiki/Meanings_of_minor-planet_names:_380001%E2%80%93381000&#34;&gt;380001-381000&lt;/a&gt;&lt;/p&gt;
&lt;p&gt;This is not the only such common sentence. There are several more.&lt;/p&gt;
&lt;p&gt;&lt;img loading=&#34;lazy&#34; src=&#34;https://sanand0.github.io/datastories/longest-wikipedia-string/screenshot.avif&#34;&gt;&lt;/p&gt;
&lt;p&gt;Here&amp;rsquo;s the Slovakia census note: 81 words that appear across &lt;strong&gt;2,920 Wikipedia pages&lt;/strong&gt;, like
&lt;a href=&#34;https://en.wikipedia.org/wiki/Sabinov%5FDistrict&#34;&gt;Sabinov District&lt;/a&gt;,
&lt;a href=&#34;https://en.wikipedia.org/wiki/Smolenice&#34;&gt;Smolenice&lt;/a&gt;,
&lt;a href=&#34;https://en.wikipedia.org/wiki/Ilija,%5FSlovakia&#34;&gt;Ilija, Slovakia&lt;/a&gt;,
&lt;a href=&#34;https://en.wikipedia.org/wiki/Balo%C5%88&#34;&gt;Baloň&lt;/a&gt;, &amp;hellip; and thousands more!&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Note on population: The difference between the population numbers above and in the census (here and below) is that the population numbers above are mostly made up of permanent residents, etc.; and the census should indicate the place where people actually mainly live. For example, a student is a citizen of a village because they have permanent residence there (they lived there as a child and has parents), but most of the time he studies at a university in the city&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;&lt;strong&gt;Note&lt;/strong&gt;: As of 26 May 2026, this has been shortened to:&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Note on population: The difference values of population numbers in the table &amp;ldquo;Population statistic&amp;rdquo; and in the sections &amp;ldquo;Ethnicity&amp;rdquo; &amp;amp; &amp;ldquo;Religion&amp;rdquo; is caused by the use of various statistical methods.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;hr&gt;
&lt;p&gt;There are several more such that you can read about in &lt;a href=&#34;https://sanand0.github.io/datastories/longest-wikipedia-string/&#34;&gt;The Paragraph That Appears 418 Times&lt;/a&gt;.&lt;/p&gt;
&lt;p&gt;That also includes how &lt;a href=&#34;https://openai.com/codex/&#34;&gt;Codex&lt;/a&gt; analyzed the &lt;a href=&#34;https://huggingface.co/datasets/wikimedia/structured-wikipedia&#34;&gt;Wikipedia structured dataset on Hugging Face&lt;/a&gt; and what else you can do with the data.&lt;/p&gt;
</description>
    </item>
    <item>
      <title>Finding subversives using Amazon wishlists</title>
      <link>https://www.s-anand.net/blog/finding-subversives-using-amazon-wishlists/</link>
      <pubDate>Wed, 11 Jan 2006 12:00:00 +0000</pubDate>
      <guid>https://www.s-anand.net/blog/finding-subversives-using-amazon-wishlists/</guid>
      <description>&lt;p&gt;&lt;a href=&#34;http://www.applefritter.com/bannedbooks&#34;&gt;Finding subversives using Amazon wishlists&lt;/a&gt;.&lt;/p&gt;
</description>
    </item>
    <item>
      <title>Datamining the NSA</title>
      <link>https://www.s-anand.net/blog/datamining-the-nsa/</link>
      <pubDate>Mon, 07 Mar 2005 12:00:00 +0000</pubDate>
      <guid>https://www.s-anand.net/blog/datamining-the-nsa/</guid>
      <description>&lt;p&gt;An information civil rights organization has &lt;a href=&#34;https://www.quintessenz.at/cgi-bin/index?id=000100003172&amp;amp;subpage=4&#34;&gt;data mined an NSA mailing list&lt;/a&gt;. The first chapter is online. The graphs are interesting.&lt;/p&gt;
</description>
    </item>
    <item>
      <title>Wal Mart mines 460 terabytes of data</title>
      <link>https://www.s-anand.net/blog/wal-mart-mines-460-terabytes-of-data/</link>
      <pubDate>Tue, 16 Nov 2004 12:00:00 +0000</pubDate>
      <guid>https://www.s-anand.net/blog/wal-mart-mines-460-terabytes-of-data/</guid>
      <description>&lt;p&gt;&lt;a href=&#34;http://www.nytimes.com/2004/11/14/business/yourmoney/14wal.html&#34;&gt;Wal Mart mines 460 terabytes of data&lt;/a&gt;.&lt;/p&gt;
</description>
    </item>
    <item>
      <title>Oracle of Google</title>
      <link>https://www.s-anand.net/blog/oracle-of-google/</link>
      <pubDate>Wed, 11 Sep 2002 12:00:00 +0000</pubDate>
      <guid>https://www.s-anand.net/blog/oracle-of-google/</guid>
      <description>&lt;p&gt;The &lt;a href=&#34;http://www.mycgiserver.com/~Morat/&#34;&gt;Oracle of Google&lt;/a&gt; is the coolest Google app so far. Ask it a question with 4 choices, and it uses Google to guess the answer. It knows that &lt;a href=&#34;http://www.mycgiserver.com/servlet/Morat.GoogleTest?question=Who+is+India%27s+President%3F&amp;amp;answers=R+Venkatraman&amp;amp;answers=Abdul+Kalam&amp;amp;answers=Shankar+Dayal+Sharma&amp;amp;answers=Vajpayee&#34;&gt;Abdul Kalam is India&amp;rsquo;s President&lt;/a&gt;, though it did &lt;a href=&#34;http://www.mycgiserver.com/servlet/Morat.GoogleTest?question=Who+is+India%27s+President%3F&amp;amp;answers=R+Venkatraman&amp;amp;answers=S+Radhakrishnan&amp;amp;answers=Shankar+Dayal+Sharma&amp;amp;answers=Vajpayee&#34;&gt;prefer Vajpayee to former Presidents&lt;/a&gt;. &lt;a href=&#34;http://google.blogspace.com/&#34;&gt;via Google Weblog&lt;/a&gt;&lt;/p&gt;
</description>
    </item>
  </channel>
</rss>
