Difference between revisions of "PresidentialScraper"
Arif Iqbal (talk | contribs) |
Athar Hameed (talk | contribs) |
||
| Line 2: | Line 2: | ||
== What is the project? == | == What is the project? == | ||
| − | Convert spike to compost ... automate the retrieval of all the stats used on [[Portal:2008_Presidential_Election]] | + | Convert spike to compost ... automate the retrieval of all the stats used on [[Portal:2008_Presidential_Election]], increase the freshness of the data. |
| + | |||
See also [[Quote-Back Technology]] | See also [[Quote-Back Technology]] | ||
| + | |||
== Why is it important? == | == Why is it important? == | ||
| + | #Very hot data | ||
| + | #Takes a lot of time to manually update stats | ||
| + | #Moves us towards implementing [[Quote-Back Technology]] | ||
| + | #Eventually people will begin to consume our data and the campaigns themselves may begin to keep track of what is happening on [[Portal:2008_Presidential_Election]] | ||
== [[DoneDone]] == | == [[DoneDone]] == | ||
| + | * Use compost to retrieve the data instead of the hacked heuristics | ||
| + | * Code is well tested | ||
| + | * Automagically refreshes the page every day | ||
| + | * Calls a human when values fall out of the expected norms | ||
| + | * BONUS: Create a machine readable datafeed of this data that others can consume. | ||
[[Category:DevelopmentTeamProject]] | [[Category:DevelopmentTeamProject]] | ||
</noinclude> | </noinclude> | ||
Revision as of 10:46, 13 August 2007
What is the project?
Convert spike to compost ... automate the retrieval of all the stats used on Portal:2008_Presidential_Election, increase the freshness of the data.
See also Quote-Back Technology
Why is it important?
- Very hot data
- Takes a lot of time to manually update stats
- Moves us towards implementing Quote-Back Technology
- Eventually people will begin to consume our data and the campaigns themselves may begin to keep track of what is happening on Portal:2008_Presidential_Election
DoneDone
- Use compost to retrieve the data instead of the hacked heuristics
- Code is well tested
- Automagically refreshes the page every day
- Calls a human when values fall out of the expected norms
- BONUS: Create a machine readable datafeed of this data that others can consume.
