This is an old revision of this page, as edited by NicDumZ (talk | contribs) at 21:40, 4 February 2008 (mmh, better with a smaller width. Btw this is the standard alert message style from fr: :þ). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.
Revision as of 21:40, 4 February 2008 by NicDumZ (talk | contribs) (mmh, better with a smaller width. Btw this is the standard alert message style from fr: :þ)(diff) ← Previous revision | Latest revision (diff) | Newer revision → (diff)What is DumZiBoT doing?
He is converting bare external links in references into named external links.
Here are some examples of his work: , , and here is what he is doing now.
He usually runs every time that a new XML dump is available.
His owner is NicDumZ.
The idea
References like these:
<ref></ref><ref>http://www.google.fr</ref>
are converted into this:
<ref></ref>
They look like this:
- The title which is used as the url title is the HTML title from the linked page. (from the <title> tag)
- newlines, linefeeds, and tabs from titles are converted into a single space to avoid long titles. Extra spaces are also removed.
- Titles containing ], several consecutive } or ' are handled correctly, converting some of the preceding characters to their html entities (This title enclose brackets [here])
- When content-type is not
text/html(medias, .pdf, .doc, etc...), I can't automatically find a title, hence I only convert references to<ref>http://lien.org/doc.pdf</ref>.
Hey, you forgot some links !
 |
If a link is unchanged after an edit by DumZiBoT, please check that you can access the linked page. If you think that a particular link was ignored by DumZiBoT because it's particular, please poke me. |
Some links may not be changed, even after DumZiBoT's run. These things may have occurred :
- The HTML linked page has no title (rare, but happens).
- DumZiBoT got an HTTP error while trying to get the page (see 4xx Client Error and 5xx Client Error). The link may be invalid, the page may not be available anymore, or may be protected. These links should be removed, but chances are that the error is temporary : That's why I do not remove these links on the basis of a single try ! Also, some pages, such as Google cache links, and Google books pages, give bots a 401/403 error although they're available.
- Either the link or the html title is blacklisted.
Blacklists
- Link blacklist : for now, only JSTOR links are ignored, since for non-registered users JSTOR gives the message: "JSTOR: Accessing JSTOR". Please contact me if you think that a particular domain should get blacklisted
- Title blacklist : Based on an original idea from Dispenser, I exclude links containing register, sign up, 404 not found, and so on.
And what about server load ?
The search for pages containing invalid references is made from the last XML dump. DumZiBoT only fetches from the servers pages that needed modifications at the time of the dump. (Some pages are downloaded but eventually do not need changes, because the references were fixed between the dump and the fetch.)
Where should I grumble report a problem ?
- User Talk:NicDumZ, and not elsewhere =)