All pastes #1503486 Raw Edit

Miscellany

public text v1 · immutable
#1503486 ·published 2009-07-22 18:25 UTC
rendered paste body
Levin:uwss ralen$ time python2.5 uwss.py -f uconfig/test.xml -c -v
-----------------------------------------------------------
[u]ber [w]eb [s]ecurity [s]canner - http://www.noptrix.net/
-----------------------------------------------------------
[*] CONFIG: Reading configuration file
[*] CONFIG: Fetch configuration options
[+] crawling site...
[*] NET: Send GET request to http://www-cs.stanford.edu/People/faculty
URL Deep: 0	ToBrowse: 5	Browsed: 1		http://www-cs.stanford.edu/People/faculty
[*] NET: Send GET request to http://www-cs.stanford.edu/People/
URL Deep: 1	ToBrowse: 15	Browsed: 2		http://www-cs.stanford.edu/People/
URL Deep: 1	ToBrowse: 14	Browsed: 2		http://www-cs.stanford.edu/People/
URL Deep: 1	ToBrowse: 13	Browsed: 2		http://www-cs.stanford.edu/People/
URL Deep: 1	ToBrowse: 12	Browsed: 2		http://www-cs.stanford.edu/People/
URL Deep: 1	ToBrowse: 11	Browsed: 2		http://www-cs.stanford.edu/People/
[*] NET: Send GET request to http://www-cs.stanford.edu/People/undergraduate_students
URL Deep: 2	ToBrowse: 10	Browsed: 3		http://www-cs.stanford.edu/People/undergraduate_students
[*] NET: Send GET request to http://www-cs.stanford.edu/People/masters_students
URL Deep: 2	ToBrowse: 9	Browsed: 4		http://www-cs.stanford.edu/People/masters_students
[*] NET: Send GET request to http://www-cs.stanford.edu/People/phd_students
URL Deep: 2	ToBrowse: 8	Browsed: 5		http://www-cs.stanford.edu/People/phd_students
[*] NET: Send GET request to http://www-cs.stanford.edu/People/undergraduate_alumni
URL Deep: 2	ToBrowse: 10	Browsed: 6		http://www-cs.stanford.edu/People/undergraduate_alumni
[*] NET: Send GET request to http://www-cs.stanford.edu/People/masters_alumni
URL Deep: 2	ToBrowse: 10	Browsed: 7		http://www-cs.stanford.edu/People/masters_alumni
[*] NET: Send GET request to http://www-cs.stanford.edu/People/phd_alumni
URL Deep: 2	ToBrowse: 9	Browsed: 8		http://www-cs.stanford.edu/People/phd_alumni
[*] NET: Send GET request to http://www-cs.stanford.edu/People/staff
URL Deep: 2	ToBrowse: 8	Browsed: 9		http://www-cs.stanford.edu/People/staff
URL Deep: 2	ToBrowse: 7	Browsed: 9		http://www-cs.stanford.edu/People/staff
URL Deep: 2	ToBrowse: 6	Browsed: 9		http://www-cs.stanford.edu/People/staff
URL Deep: 2	ToBrowse: 5	Browsed: 9		http://www-cs.stanford.edu/People/staff
URL Deep: 2	ToBrowse: 4	Browsed: 9		http://www-cs.stanford.edu/People/staff
URL Deep: 3	ToBrowse: 3	Browsed: 10		http://www-cs.stanford.edu/~atwood/
URL Deep: 3	ToBrowse: 2	Browsed: 11		http://www-cs.stanford.edu/People/htto://www.stanford.edu/~timc
URL Deep: 3	ToBrowse: 1	Browsed: 12		http://www-cs.stanford.edu/~shehzaad/
URL Deep: 3	ToBrowse: 0	Browsed: 12		http://www-cs.stanford.edu/~atwood/
[*] CRAWLER: save collected data to /tmp/uwss.dat
[+] finished crawling -> Links: 35 / Forms: 0

[]

real	0m46.678s
user	0m3.604s
sys	0m0.223s
Levin:uwss ralen$ cat /tmp/uwss.dat 
(lp0
Vhttp://www-cs.stanford.edu/%CHANGEME%/
p1
aVhttp://www-cs.stanford.edu/%CHANGEME%/phd_students
p2
aVhttp://www-cs.stanford.edu/%CHANGEME%/undergraduate_students
p3
aS'http://www-cs.stanford.edu/People/%CHANGEME%'
p4
aVhttp://www-cs.stanford.edu/%CHANGEME%/staff
p5
aVhttp://www-cs.stanford.edu/People/masters_students
p6
aVhttp://www-cs.stanford.edu/People/undergraduate_students
p7
aVhttp://www-cs.stanford.edu/People/phd_students
p8
aS'http://www-cs.stanford.edu/People/faculty'
p9
aVhttp://www-cs.stanford.edu/~shehzaad/
p10
aVhttp://www-cs.stanford.edu/People/htto://www.stanford.edu/~timc
p11
aVhttp://www-cs.stanford.edu/%CHANGEME%/undergraduate_alumni
p12
aS'http://www-cs.stanford.edu/%CHANGEME%/faculty'
p13
aVhttp://www-cs.stanford.edu/People/undergraduate_alumni
p14
aVhttp://www-cs.stanford.edu/People/masters_alumni
p15
aVhttp://www-cs.stanford.edu/%CHANGEME%/phd_alumni
p16
aVhttp://www-cs.stanford.edu/People/htto://www.stanford.edu/%CHANGEME%
p17
aVhttp://www-cs.stanford.edu/%CHANGEME%/masters_students
p18
aVhttp://www-cs.stanford.edu/~atwood/%CHANGEME%
p19
aVhttp://www-cs.stanford.edu/People/staff
p20
aVhttp://www-cs.stanford.edu/%CHANGEME%/masters_alumni
p21
aVhttp://www-cs.stanford.edu/~atwood/
p22
aVhttp://www-cs.stanford.edu/People/phd_alumni
p23
aVhttp://www-cs.stanford.edu/People/
p24
aVhttp://www-cs.stanford.edu/~shehzaad/%CHANGEME%
p25
a.(lp0
.Levin:uwss ralen$