Wikistats/ToDo

Tasks for Wikistats
[1] http://meta.wikimedia.org/wiki/Talk:List_of_Wikimedia_Projects_by_Size#The_table_is_broken [1] (mutante) [2] add activeusers to _wiki,_csv,_ssv (mutante)

Regularly observe

 * oldest
 * NULL wikis
 * statuses
 * WikiXray
 * WikiIndex_Pages_on_indexed_Wikis
 * meta:Talk:List of Wikipedias

Retrieve method codes
(mysql> select textstats,count(id) from mediawikis group by textstats;)

update schedule

 * EditThis 23.30
 * Wikipedia 0 and 12
 * Wiktionary 0.30 and 12.30
 * Wikibooks 1 and 13
 * S23 1
 * List of Wikiquotes 1.30 and 13.30
 * List of Private Mediawikis 2 and 14
 * Wikinews 3 and 15
 * Wikisource 3.15 and 15.15
 * Wiki-Site 3
 * Wikimedia Specials 3.30 and 15.30
 * updating Code 0 entries 4+10+16+22
 * Wikitravel 4
 * Anarchopedia 4.30
 * Uncyclomedia 5
 * Elwiki 6
 * Qweki 6.45
 * Hyperwave 7
 * Scribblewiki 7
 * update hostlists: 7 on sundays
 * Gratis-Wiki 8
 * Wikia 9
 * Wikible 9
 * openSUSE 9.30
 * Mozilla Development Center 10
 * Wik.is 11
 * Gentoo 11.30
 * Wikifur 14.00
 * write timestamp for last update on index page 23.23

Request for adding wikis
Please add these wikis:
 * TechPresentations
 * MediaWiki Widgets
 * Sharing Buttons

Thank you, Sergey Chernyshev 17:34, 25 May 2009 (UTC)


 * The third one had not a working statistics, the other two are added. RobiH 18:57, 25 May 2009 (UTC)

Hello, I hope I'm right here, can you add the following German wikis (mediaWiki), they all have more than 1.000 articles:


 * YugiOh
 * VereinsWiki
 * Ardapedia
 * Myrapedia
 * Heroes

Thank you!--Yatina 00:04, 19 August 2008 (CEST)


 * Done. RobiH 22:04, 19 August 2008 (CEST)

Hello, I have just noticed that my wiki is not in the list: WikiSara Can you add it, please?--G.E. 16:54, 3 December 2008 (CET)


 * It is a Wikia. It will automatically be included from the official Wikia hostlist as soon as it appears there. RobiH 17:40, 14 January 2009 (UTC)

Hi, I've also noticed that a wiki I work on is not on the list: *Wikia Gaming Thanks. -- Wikia Gaming - AlphaTwo


 * Gaming Wikia is listed as "Cheatbase". RobiH 17:38, 14 January 2009 (UTC)


 * Hi, according to thiswikia has more than 6000 wiki sites now.It seems that wikia wikis created in recent time were not automatically included.--Ffaarr 03:24, 18 February 2009 (UTC)
 * some of the newly created sites in wikia are in this list--Ffaarr 02:53, 20 February 2009 (UTC)



Before we had 3362 Wikias. What ? 3362 vs. > 6000 ?

Damn?! Really?

starting ./hostlists/update_wikia.sh

Warning: file_get_contents(http://www.wikia.com/dbdumps/dbdumps.html): failed to open stream: HTTP request failed! HTTP/1.1 404 Not Found

arrr

Made new hostlist update script, fetching data from

http://www.wikia.com/wiki/Wikia:List_of_Wikia/A http://www.wikia.com/wiki/Wikia:List_of_Wikia/D http://www.wikia.com/wiki/Wikia:List_of_Wikia/H http://www.wikia.com/wiki/Wikia:List_of_Wikia/M http://www.wikia.com/wiki/Wikia:List_of_Wikia/Q http://www.wikia.com/wiki/Wikia:List_of_Wikia/T

found 7232 lines (wikis) in the update file after running it,..

now inserting...and trying to fetch data...

mysql> delete from wikia; Query OK, 3362 rows affected (0.06 sec)

inserting from new file (with --force so duplicates do not stop others from being inserted)

Now:

7201 Wikis in database


 * http://s23.org/wikistats/wikia_html.php

mutante 12:04, 23 February 2009 (UTC)


 * Thank you very much for adding a lot of sites into stats.

But I found many of the sites included before are now not listed in. For example etc. I tried to find the reason and just found that the list here are not auto-added but added by hand. So there are many sites missed in that list and some sites are listed twice.


 * The List of the New ones has been added. RobiH 16:32, 25 February 2009 (UTC)

I found this site are the complete sites for wikia.（Even the sites created this week are included）Is this data convenient to be inserted in？


 * This List is password protected and cannot be harvested by our robot. RobiH 16:32, 25 February 2009 (UTC)

Thank you very much.--Ffaarr 14:04, 23 February 2009 (UTC)

Ffaarr, maybe, if you have more contacts with Wikia people, try to convince them its a nice thing to provide a URL with a list of ALL Wikias that can be seen public without having to login. It would be perfect if it was: complete (including ALL Wikias), free of dupes, always up to date or at least updated frequently, publicly accesible and in plain text, XML or some form that is easy to parse. Shouldnt be that much work for somebody who has Wikia shell access, i think, just have to find the right people to talk into it. mutante 20:47, 25 February 2009 (UTC)

Thank you very much.Newly created sites（maybe after 2007）are all included in these lists and newly created sites are daily updated by bot. this list here（the list you just adde in） So the newer sites are very complete now and only some of old sites sites created before 2007 are not listed in. I'll try to ask wikia for more complete information.

Another question.Does sites hosted by wikia but with different domain（like  wowwiki.com/  memory-alpha.org/  wiki.ffxiclopedia.org/  etc）listed in this table？Thank you very much.--Ffaarr 01:35, 26 February 2009 (UTC)


 * Added. RobiH 18:47, 3 March 2009 (UTC)
 * thank you very much.--Ffaarr 00:39, 4 March 2009 (UTC)

HI, I still didn't get answer from wikia. So I made a list of the main sites（sites with more articles） which are not listed in. here After added these sites I think it will make at least the list for 500+ article sites almost complete.Thank you --Ffaarr 02:59, 2 March 2009 (UTC)

I imported more wikis from the link you provided, actually 158 more that were not duplicates. Greets, mutante 19:43, 4 March 2009 (UTC)


 * I'll take care of the list. Will ping you here once it's ready. --Avatar 05:28, 24 June 2009 (UTC)


 * Here it is:
 * All Wikia Wikis (xml) or
 * All Wikia Wikis (csv)
 * Information is cached for 6 hours. If you need further information included into the list, tell me. --Avatar 11:21, 10 July 2009 (UTC)

Can you rename Betawiki to translatewiki.net? – 94.101.5.99 19:17, 7 May 2009 (UTC) (http://translatewiki.net/wiki/User:Nike)

Done. mutante 21:06, 16 July 2009 (UTC)

Please add this wiki:

daidalos.kion.com.mx

(is a new wiki in spanish and active with 20 articles at this moment) --Mnts 01:58, 11 August 2009 (UTC)

Please add New World Encyclopedia. Thanks! 71.171.124.186 23:54, 12 October 2009 (UTC)


 * Both done. RobiH 19:45, 13 October 2009 (UTC)

Bartender's Database
Hello! Can you please add http://www.bartendersdatabase.com ?

Thanks!

--204.138.115.3 14:03, 29 October 2009 (UTC)


 * Added. RobiH 21:04, 29 October 2009 (UTC)

Parsing error
It appears that the raw stats from the Wiki wikis are not being parsed properly. For example, the raw feed for Memory Alpha is

total=84206;good=30321;views=0;edits=978885;users=1373059;activeusers=510;admins=22;images=21264;jobs=126

but the parsed and formatted stats line is

№	Name 			Good 	Total 	Edits 	Views 	Admins 	Users	 	Images 	Stub Ratio 	Last checked 12 	en.memory-alpha 	30318 	84194 	978820 	0 	510 	1373059 	22 	0.3601		2009-05-21 11:06:46

The admins stat is actually the active users number, and the images stat is actually the admins number.

Thanks! -- 207.181.180.2 14:24, 21 May 2009 (UTC)

I haved added "Active users" to the database, the update script and http://s23.org/wikistats/wikia_html.php?sort=ausers_desc. update is currently running ... mutante 21:19, 29 May 2009 (UTC)

Incorrect image counts
Image counts on http://s23.org/wikistats/ look a wee bit questionable; zero images for all of editthis and 422 images for all uncyclomedia wikis? One individual wiki from one of these sets http://desciclopedia.org/wiki/Especial:Estatísticas is showing 77 525 images on the site's own MW1.16 statistics page - admittedly that is one of the larger wikis, but still it's one individual project among many.

Any chance that the MediaWiki 1.16 upgrades are breaking things? The "activeusers" field did not exist in special:statistics in some of the older MW versions but is standard now. (Not that this would explain Wikia, they're still running two versions behind Wikipedia and others) --66.102.80.212 23:09, 6 September 2009 (UTC)

I added the activeusers column to the update scripts and html pages of: wmspecials, wikiquotes, wikinews, wikibooks, wikisources, wikipedias, wiktionary, uncyclomedia, anarchopedias, wikiversity, gentoo.

Mediawikis, wikifur and wikia already had them. The others dont have activeusers columns in their stats yet.

For uncyclomedia i also added it in _wiki ,_csv, and _ssv. For wiktionary ,wikisources and wikipedia: _wiki. @Robih: But please check them and list for me what is missing now. mutante 16:56, 4 October 2009 (UTC)

Add Creative Commons wiki

 * http://wiki.creativecommons.org -- you may wish to add this one, as we are running MW 1.14, and (an old version of) AbuseFilter, along with SemanticWiki. Thanks! 75.213.144.192 (really, http://en.wikipedia.org/wiki/User:JesseW/not_logged_in ) 06:08, 13 July 2009 (UTC)


 * It is already in. RobiH 15:40, 14 July 2009 (UTC)

Add n:tr
Hi! Tr Wikinews is open: http://tr.wikinews.org/wiki/Ana_sayfa. Could you add it in http://s23.org/wikistats/wikinews_wiki.php ? Thanks, XalD 21:42, 14 August 2009 (UTC)

Alright, i have just added it. Greets, mutante 21:06, 16 August 2009 (UTC)


 * Thanks a lot :) XalD 00:27, 26 August 2009 (UTC)

WikiFur
WikiFur's entries may need updating - we have completed our migration from Wikia - all sites are now hosted off subdomains of wikifur.com. furry.wikia.com should be going away by the end of the month. GreenReaper 05:29, 22 August 2009 (UTC)

Thanks for the info. What about http://www.wikilurv.se/ ? mutante 18:57, 25 August 2009 (UTC)


 * WikiLurv is a separately-hosted and run wiki which is considered our Swedish partner, to the extent that we share interlanguage links and include them in our stats. It is not however hosted or controlled by WikiFur - the administrator decided they wanted the experience of running it themselves. TurriWiki is in a similar situation, except that it was founded separately a few months before WikiFur. GreenReaper 21:54, 25 August 2009 (UTC)
 * Oh, and there seems to be an additional entry in this list for "English Wikifur" with unrunescape.wikia.com as the address. It is a duplicate of the unrunescape entry. The admin values for TurriWiki and WikiLurv also appear to be incorrect. GreenReaper 22:23, 25 August 2009 (UTC)

Add/update a list of sites using a particular MediaWiki extension
The list of wikis using mw:extension:SpecialNamespaces http://s23.org/wikistats/mediawiki_extensions.php?id=991 needs to be updated to reflect that the MediaWiki page about the extension was moved (from "simple namepaces" to "SpecialNamespaces"). The list of wikis known to use some form of the extension includes all Illogicopedias and those portions of Uncyclopedia (Uncyclomedia) hosted outside Wikia:

Illogicopedias (by language, ISO):
 * en 	http://en.illogicopedia.org/wiki/$1
 * fr 	http://fr.illogicopedia.org/wiki/$1
 * nl 	http://nl.illogicopedia.org/wiki/$1
 * no 	http://no.illogicopedia.org/wiki/$1

Uncyclomedia individual wikis (non-Wikia, by language, ISO):
 * bg 	http://bg.oxypedia.net/wiki/$1
 * bn 	http://bn.uncyc.org/wiki/$1
 * bs 	http://bs.neciklopedija.org/wiki/$1
 * cy 	http://cy.uncyclopedia.org.uk/wiki/$1
 * et 	http://ebatsuklopeedia.org/wiki/$1
 * fa 	http://fa.uncyc.org/wiki/$1
 * fi 	http://hikipedia.info/wiki/$1
 * ga 	http://ga.uncyc.org/wiki/$1
 * got 	http://unsaiklopedia.org/wiki/$1
 * hr 	http://hr.neciklopedija.org/wiki/$1
 * hu 	http://unciklopedia.org/wiki/$1
 * hy 	http://angragitaran.org/wiki/$1
 * ja 	http://ansaikuropedia.org/wiki/$1
 * ka 	http://anciklopedia.org/wiki/$1
 * km 	http://km.uncyclopedia.info/wiki/$1
 * ko 	http://uncyclopedia.kr/wiki/$1
 * lb 	http://kengencyclopedia.org/wiki/$1
 * li 	http://kwatsjpedia.org/wiki/$1
 * lo 	http://lo.uncyclopedia.info/wiki/$1
 * lt 	http://juokopedija.org/wiki/$1
 * lv 	http://lv.neciklopedija.org/wiki/$1
 * mg 	http://hatsiklopedia.org/wiki/$1
 * mk 	http://mk.neciklopedija.org/wiki/$1
 * mo 	http://uichipedia.net/wiki/$1
 * ms 	http://bodohpedia.org/wiki/$1
 * nl 	http://oncyclopedia.net/wiki/$1
 * nn 	http://ikkjepedia.org/wiki/$1
 * no 	http://ikkepedia.org/wiki/$1
 * oc 	http://oisquipedia.org/wiki/$1
 * pt 	http://desciclopedia.org/wiki/$1
 * ro 	http://uncyclopedia.ro/wiki/$1
 * sco 	http://scotypedia.org/wiki/$1
 * sl 	http://butalopedija.org/wiki/$1
 * sr 	http://sr.neciklopedija.org/wiki/$1
 * sv 	http://psyklopedin.org/wiki/$1
 * th 	http://th.uncyclopedia.info/wiki/$1
 * tl 	http://pekepedia.net/wiki/$1
 * tr 	http://yansiklopedi.org/wiki/$1
 * uk 	http://inciklopedia.org/wiki/$1
 * zh-tw 	http://uncyclopedia.tw/wiki/$1

Uncyclomedia (misc): Others:
 * en	common 	http://commons.uncyclomedia.org/wiki/$1
 * en	info 	http://uncyclopedia.info/wiki/$1
 * en	meta 	http://meta.uncyclomedia.org/wiki/$1
 * ko	meta	http://meta.uncyclopedia.kr/wiki/$1
 * en	complaintwiki 	http://complaintwiki.org/wiki/$1
 * en	daemonica 	http://daemonica.org/wiki/$1
 * en	zombiepedia 	http://zombie.pedia.ws/wiki/$1

Hi, i have updated the short name in my database. See http://s23.org/wikistats/mediawiki_extensions.php?id=991 reflecting the new name now. Now i will have to let it update somehow.. hold on. mutante 19:42, 21 September 2009 (UTC)

Category
Hi! Could you add in http://s23.org/wikistats/wikinews_wiki.php ? On the bottom, please. Thanks, XalD 21:23, 27 October 2009 (UTC)

Done. mutante 05:35, 3 November 2009 (UTC)