| Revision as of 10:21, 14 November 2010 edit98.222.57.24 (talk) Nobody is looking at the config, so people can ask individually for it. Also, dataset review interface instructions have been moved to the interface itself.← Previous edit | Revision as of 10:36, 14 November 2010 edit undo98.222.57.24 (talk) Some improvements to userpage.Next edit → | ||
| Line 2: | Line 2: | ||
| * Christopher Breneman — {{user|Crispy1989}} — wrote and maintains the core engine and core configuration. | * Christopher Breneman — {{user|Crispy1989}} — wrote and maintains the core engine and core configuration. | ||
| * Cobi Carter — {{user|Cobi}} — wrote and maintains the Misplaced Pages interface code and dataset review interface. | * Cobi Carter — {{user|Cobi}} — wrote and maintains the Misplaced Pages interface code and dataset review interface. | ||
| * Tim — {{user|Tim1357}} — wrote |
* Tim — {{user|Tim1357}} — wrote the original dataset downloader code and scripts to generate portions of the original dataset. | ||
| Questions, comments, contributions, and suggestions regarding: | Questions, comments, contributions, and suggestions regarding: | ||
| * the core engine, algorithms, and configuration should be directed to {{user|Crispy1989}}. | * the core engine, algorithms, and configuration should be directed to {{user|Crispy1989}}. | ||
| * the bot's |
* the bot's interface to Misplaced Pages and dataset review interface should be directed to {{user|Cobi}}. | ||
| * the bot's dataset should be directed to {{user|Tim1357}}. | * the bot's original dataset should be directed to {{user|Tim1357}}. | ||
| == Dataset Review Interface == | |||
| For the bot to be effective, the dataset needs to be expanded. Our current dataset has some degree of bias, as well as some inaccuracies. We need volunteers to help review edits and classify them as either vandalism or constructive. We hope to eventually completely replace our current dataset with a random sampling of edits, reviewed and classified by volunteers. A list of current contributors, more thorough instructions on how to use the interface, and the interface itself, are at the . | |||
| == Languages == | == Languages == | ||
| Line 14: | Line 16: | ||
| * ] / ] — The core is written in C/C++ from scratch. | * ] / ] — The core is written in C/C++ from scratch. | ||
| * ] — The bot shell (Misplaced Pages interface) is written in PHP, and shares some code with the original ClueBot. | * ] — The bot shell (Misplaced Pages interface) is written in PHP, and shares some code with the original ClueBot. | ||
| ⚫ | * ] — Some of the dataset management tools |
||
| ⚫ | * ] — A few scripts to make it easier to train and maintain the bot are Bash scripts. | ||
| * ] — The dataset review interface is written in Java using the Google App framework. | * ] — The dataset review interface is written in Java using the Google App framework. | ||
| ⚫ | * ] — A few scripts to make it easier to train and maintain the bot are Bash scripts. | ||
| ⚫ | * ] — Some of the original dataset management and downloader tools were written in Python. | ||
| == Statistics == | == Statistics == | ||
Revision as of 10:36, 14 November 2010
Team
- Christopher Breneman — Crispy1989 (talk · contribs) — wrote and maintains the core engine and core configuration.
- Cobi Carter — Cobi (talk · contribs) — wrote and maintains the Misplaced Pages interface code and dataset review interface.
- Tim — Tim1357 (talk · contribs) — wrote the original dataset downloader code and scripts to generate portions of the original dataset.
Questions, comments, contributions, and suggestions regarding:
- the core engine, algorithms, and configuration should be directed to Crispy1989 (talk · contribs).
- the bot's interface to Misplaced Pages and dataset review interface should be directed to Cobi (talk · contribs).
- the bot's original dataset should be directed to Tim1357 (talk · contribs).
Dataset Review Interface
For the bot to be effective, the dataset needs to be expanded. Our current dataset has some degree of bias, as well as some inaccuracies. We need volunteers to help review edits and classify them as either vandalism or constructive. We hope to eventually completely replace our current dataset with a random sampling of edits, reviewed and classified by volunteers. A list of current contributors, more thorough instructions on how to use the interface, and the interface itself, are at the dataset review interface.
Languages
- C / C++ — The core is written in C/C++ from scratch.
- PHP — The bot shell (Misplaced Pages interface) is written in PHP, and shares some code with the original ClueBot.
- Java — The dataset review interface is written in Java using the Google App framework.
- Bash — A few scripts to make it easier to train and maintain the bot are Bash scripts.
- Python — Some of the original dataset management and downloader tools were written in Python.
Statistics
As Cluebot-NG requires a dataset to function, the dataset can also be used to give fairly accurate statistics on its accuracy and operation. Different parts of the dataset are used for training and trialing, so these statistics are not biased.
The exact statistics change and improve frequently as we update the bot. Currently:
- Selecting a threshold to optimize total accuracy, the bot correctly classifies over 90% of edits.
- Selecting a threshold to hold false positives at a maximal rate of 0.25%, the bot catches approximately 63% of all vandalism.