All pastes #2129682 Raw Edit

Stuff

public text v1 · immutable
#2129682 ·published 2012-03-18 18:18 UTC
rendered paste body
Title: Bulk PHP File Checker On Remote Servers

Project Type:  Programmed Software, Windows (x64) Application OR Web Application (Including Source Code)

Language: C#.NET, C++, VB.NET (Visual Basic 2010), OR PHP Script

Budget: $150 total, with (1) proposed 'milestone' payment of $75 for a completed version that checks a limited number of URLs

Project Summary: This project description is for a program or web script with the purpose of checking whether or not a *.php file exists on a list of remote servers.  The file that will be checked will always be named "register.php".  The program will input a file named URLs.txt with a list of URLs (one per line) and check each URL, determining if register.php exists or not.  If register.php is found on the remote server, it will be appended and saved to "found.txt".  If register.php is not found on the server, the program will append and save the URL to "notfound.txt".  I believe it's possible to only read headers to tell if the file exists, rather than looking through html.  The program must have at least 90% accuracy, and check at least 2 million URLs per hour on a high end CPU 32GB RAM 10gbps bandwidth machine.

File Input
URLs.txt (With or without http:// and www., NOT case sensitive)

File Output
found.txt, notfound.txt

An example list of URLs to test with can be downloaded as an attachment on this project.  This software/web script will be used on over 1 billion URLs, so it's speed and efficiency is very important.

I'm happy to answer any questions about this project and its best -first- to contact me via Private Message that I will check many times every day as long as this project is open.  Keep in mind, I will only pay the first milestone payment AFTER reviewing the demonstration application.  If you have any ideas however for a different demonstration application and milestone, I am willing to listen.  Thank you and good luck!