Wikistats/ToDo

Tasks for Wikistats
[x] Wikifur: Make csv, ssv, xml, odd (mutante) | done, but please not verified, please identify possible problems, odd may have broken links etc.. [1] Wikia: Keep track of Wikia Stats (robiH) [x] Mediawiki: Mail to the Admins of Wikis with Error 412 (robiH) [ ] Add Wikias from http://www.wikia.com/wiki/Special:Newwikis?format=xml or format=csv (mutante) | does not work, loads forever ? outdated by wiki-stats.wikia ?

Regularly observe

 * oldest
 * NULL wikis
 * statuses
 * WikiXray
 * WikiIndex_Pages_on_indexed_Wikis
 * meta:Talk:List of Wikipedias

Retrieve method codes
(mysql> select textstats,count(id) from mediawikis group by textstats;)

update schedule

 * EditThis 23.30
 * Wikipedia 0 and 12
 * Wiktionary 0.30 and 12.30
 * Wikibooks 1 and 13
 * S23 1
 * List of Wikiquotes 1.30 and 13.30
 * List of Private Mediawikis 2 and 14
 * Wikinews 3 and 15
 * Wikisource 3.15 and 15.15
 * Wiki-Site 3
 * Wikimedia Specials 3.30 and 15.30
 * updating Code 0 entries 4+10+16+22
 * Wikitravel 4
 * Anarchopedia 4.30
 * Uncyclomedia 5
 * Elwiki 6
 * Qweki 6.45
 * Hyperwave 7
 * Scribblewiki 7
 * update hostlists: 7 on sundays
 * Gratis-Wiki 8
 * Wikia 9
 * Wikible 9
 * openSUSE 9.30
 * Mozilla Development Center 10
 * Wik.is 11
 * Gentoo 11.30
 * Wikifur 14.00
 * write timestamp for last update on index page 23.23

Request for adding wikis
Please add these wikis:
 * TechPresentations
 * MediaWiki Widgets
 * Sharing Buttons

Thank you, Sergey Chernyshev 17:34, 25 May 2009 (UTC)


 * The third one had not a working statistics, the other two are added. RobiH 18:57, 25 May 2009 (UTC)

Hello, I hope I'm right here, can you add the following German wikis (mediaWiki), they all have more than 1.000 articles:


 * YugiOh
 * VereinsWiki
 * Ardapedia
 * Myrapedia
 * Heroes

Thank you!--Yatina 00:04, 19 August 2008 (CEST)


 * Done. RobiH 22:04, 19 August 2008 (CEST)

Hello, I have just noticed that my wiki is not in the list: WikiSara Can you add it, please?--G.E. 16:54, 3 December 2008 (CET)


 * It is a Wikia. It will automatically be included from the official Wikia hostlist as soon as it appears there. RobiH 17:40, 14 January 2009 (UTC)

Hi, I've also noticed that a wiki I work on is not on the list: *Wikia Gaming Thanks. -- Wikia Gaming - AlphaTwo


 * Gaming Wikia is listed as "Cheatbase". RobiH 17:38, 14 January 2009 (UTC)


 * Hi, according to thiswikia has more than 6000 wiki sites now.It seems that wikia wikis created in recent time were not automatically included.--Ffaarr 03:24, 18 February 2009 (UTC)
 * some of the newly created sites in wikia are in this list--Ffaarr 02:53, 20 February 2009 (UTC)



Before we had 3362 Wikias. What ? 3362 vs. > 6000 ?

Damn?! Really?

starting ./hostlists/update_wikia.sh

Warning: file_get_contents(http://www.wikia.com/dbdumps/dbdumps.html): failed to open stream: HTTP request failed! HTTP/1.1 404 Not Found

arrr

Made new hostlist update script, fetching data from

http://www.wikia.com/wiki/Wikia:List_of_Wikia/A http://www.wikia.com/wiki/Wikia:List_of_Wikia/D http://www.wikia.com/wiki/Wikia:List_of_Wikia/H http://www.wikia.com/wiki/Wikia:List_of_Wikia/M http://www.wikia.com/wiki/Wikia:List_of_Wikia/Q http://www.wikia.com/wiki/Wikia:List_of_Wikia/T

found 7232 lines (wikis) in the update file after running it,..

now inserting...and trying to fetch data...

mysql> delete from wikia; Query OK, 3362 rows affected (0.06 sec)

inserting from new file (with --force so duplicates do not stop others from being inserted)

Now:

7201 Wikis in database


 * http://s23.org/wikistats/wikia_html.php

mutante 12:04, 23 February 2009 (UTC)


 * Thank you very much for adding a lot of sites into stats.

But I found many of the sites included before are now not listed in. For example etc. I tried to find the reason and just found that the list here are not auto-added but added by hand. So there are many sites missed in that list and some sites are listed twice.


 * The List of the New ones has been added. RobiH 16:32, 25 February 2009 (UTC)

I found this site are the complete sites for wikia.（Even the sites created this week are included）Is this data convenient to be inserted in？


 * This List is password protected and cannot be harvested by our robot. RobiH 16:32, 25 February 2009 (UTC)

Thank you very much.--Ffaarr 14:04, 23 February 2009 (UTC)

Ffaarr, maybe, if you have more contacts with Wikia people, try to convince them its a nice thing to provide a URL with a list of ALL Wikias that can be seen public without having to login. It would be perfect if it was: complete (including ALL Wikias), free of dupes, always up to date or at least updated frequently, publicly accesible and in plain text, XML or some form that is easy to parse. Shouldnt be that much work for somebody who has Wikia shell access, i think, just have to find the right people to talk into it. mutante 20:47, 25 February 2009 (UTC)

Thank you very much.Newly created sites（maybe after 2007）are all included in these lists and newly created sites are daily updated by bot. this list here（the list you just adde in） So the newer sites are very complete now and only some of old sites sites created before 2007 are not listed in. I'll try to ask wikia for more complete information.

Another question.Does sites hosted by wikia but with different domain（like  wowwiki.com/  memory-alpha.org/  wiki.ffxiclopedia.org/  etc）listed in this table？Thank you very much.--Ffaarr 01:35, 26 February 2009 (UTC)


 * Added. RobiH 18:47, 3 March 2009 (UTC)
 * thank you very much.--Ffaarr 00:39, 4 March 2009 (UTC)

HI, I still didn't get answer from wikia. So I made a list of the main sites（sites with more articles） which are not listed in. here After added these sites I think it will make at least the list for 500+ article sites almost complete.Thank you --Ffaarr 02:59, 2 March 2009 (UTC)

I imported more wikis from the link you provided, actually 158 more that were not duplicates. Greets, mutante 19:43, 4 March 2009 (UTC)


 * I'll take care of the list. Will ping you here once it's ready. --Avatar 05:28, 24 June 2009 (UTC)


 * Here it is:
 * All Wikia Wikis (xml) or
 * All Wikia Wikis (csv)
 * Information is cached for 6 hours. If you need further information included into the list, tell me. --Avatar 11:21, 10 July 2009 (UTC)

Can you rename Betawiki to translatewiki.net? – 94.101.5.99 19:17, 7 May 2009 (UTC) (http://translatewiki.net/wiki/User:Nike)

Done. mutante 21:06, 16 July 2009 (UTC)

Parsing error
It appears that the raw stats from the Wiki wikis are not being parsed properly. For example, the raw feed for Memory Alpha is

total=84206;good=30321;views=0;edits=978885;users=1373059;activeusers=510;admins=22;images=21264;jobs=126

but the parsed and formatted stats line is

№	Name 			Good 	Total 	Edits 	Views 	Admins 	Users	 	Images 	Stub Ratio 	Last checked 12 	en.memory-alpha 	30318 	84194 	978820 	0 	510 	1373059 	22 	0.3601		2009-05-21 11:06:46

The admins stat is actually the active users number, and the images stat is actually the admins number.

Thanks! -- 207.181.180.2 14:24, 21 May 2009 (UTC)

I haved added "Active users" to the database, the update script and http://s23.org/wikistats/wikia_html.php?sort=ausers_desc. update is currently running ... mutante 21:19, 29 May 2009 (UTC)

Add Creative Commons wiki

 * http://wiki.creativecommons.org -- you may wish to add this one, as we are running MW 1.14, and (an old version of) AbuseFilter, along with SemanticWiki. Thanks! 75.213.144.192 (really, http://en.wikipedia.org/wiki/User:JesseW/not_logged_in ) 06:08, 13 July 2009 (UTC)


 * It is already in. RobiH 15:40, 14 July 2009 (UTC)