John Benediktsson
|
c68db22281
|
spider: reuse url ref inside fill-spidered-result.
|
2013-12-08 09:15:42 -08:00 |
Doug Coleman
|
b4037edf48
|
spider: Don't try to parse non-html as html.
|
2013-12-07 11:43:32 -08:00 |
|
Doug Coleman
|
74f3579644
|
Fix the max-depth variable in spider
|
2010-08-29 13:21:50 -05:00 |
|
Doug Coleman
|
8b0a95e4a0
|
Refactor spider vocab to fix a bug and remove a rot
|
2010-08-18 11:35:08 -05:00 |
Daniel Ehrenberg
|
da57436180
|
Finishing eliminating prune as a synonym of members
|
2010-02-27 14:52:24 -05:00 |
Slava Pestov
|
220dd88a2c
|
Update documentation for new help lint check
|
2010-02-19 12:31:52 +13:00 |
|
Slava Pestov
|
7f889e4bb3
|
spider.unique-deque: fix for stricter stack effect checking
|
2009-11-09 01:59:22 -06:00 |
Joe Groff
|
a5957b188d
|
nip most uses of tuck from extra
|
2009-11-05 22:22:21 -06:00 |
|
Joe Groff
|
cac1778bd0
|
remove most uses of roll/-roll from extra
|
2009-10-30 14:14:24 -05:00 |
|
Joe Groff
|
6e1bffb1c5
|
update existing code to use :> ( ) when possible
|
2009-10-28 16:11:33 -05:00 |
Keith Lazuka
|
405e5d015b
|
docs: change $subsection to $subsections
|
2009-10-02 12:15:48 -04:00 |
|
Doug Coleman
|
eceed177d6
|
replace usages of <" with """
|
2009-09-20 22:42:40 -05:00 |
|
Doug Coleman
|
3f3d57032b
|
Delete empty unit tests files, remove 1- and 1+, reorder IN: lines in a lot of places, minor refactoring
|
2009-08-13 19:21:44 -05:00 |
Slava Pestov
|
65faa3fda3
|
Fix unit tests and load errors for slip removal
|
2009-05-10 17:03:41 -05:00 |
Doug Coleman
|
47369e927c
|
add a combinator to spider
|
2009-04-09 15:29:38 -05:00 |
Slava Pestov
|
9f08e3a6bf
|
Working on site-watcher
|
2009-04-06 21:59:27 -05:00 |
|
Doug Coleman
|
a380ae2239
|
refactor spider
|
2009-04-06 18:47:46 -05:00 |
|
Slava Pestov
|
e9b9907ef9
|
Factor out site-watcher.email, start work on site-watcher.spider
|
2009-04-06 17:49:34 -05:00 |
|
Doug Coleman
|
284511a2e7
|
fix load erro
|
2009-04-04 15:47:17 -05:00 |
|
Doug Coleman
|
e929c397d1
|
refactoring spider
|
2009-04-04 11:57:23 -05:00 |
|
Doug Coleman
|
dd4766798c
|
Merge branch 'master' of git://factorcode.org/git/factor
|
2009-04-03 21:18:43 -05:00 |
|
Slava Pestov
|
95f304bee0
|
Check in spider.report
|
2009-04-03 21:16:27 -05:00 |
|
Doug Coleman
|
1ee52e2090
|
refactoring spider
|
2009-04-03 21:16:08 -05:00 |
|
Doug Coleman
|
4c7b2f9337
|
fix deriving urls in spider
|
2009-04-03 20:05:19 -05:00 |
|
Doug Coleman
|
b35bb10123
|
spider - better handling of relative links for frames, dont spider things twice
|
2009-04-01 11:08:19 -05:00 |
|
Doug Coleman
|
19d8a6a552
|
remove some dead code, make spider use count and max-count again
|
2009-03-31 23:04:59 -05:00 |
|
Doug Coleman
|
e22823f2c4
|
rename word
|
2009-03-31 18:23:02 -05:00 |
|
Doug Coleman
|
ce04d1dfa9
|
redo spider without dynamic variables
|
2009-03-31 18:21:15 -05:00 |
|
Doug Coleman
|
55bb5f0cd4
|
fix typo in example
|
2009-03-20 22:40:46 -05:00 |
|
Doug Coleman
|
a130928ec2
|
fix docs
|
2008-10-04 13:28:42 -05:00 |
|
Doug Coleman
|
af37d28042
|
remove relative-urls? word and some dead code
|
2008-10-04 13:27:29 -05:00 |
|
Doug Coleman
|
7308f2fb52
|
fix shiz
|
2008-10-01 21:30:12 -05:00 |
|
Doug Coleman
|
29a0a7375a
|
Merge branch 'master' of git://factorcode.org/git/factor
|
2008-10-01 21:26:59 -05:00 |
|
Doug Coleman
|
a10c3f425c
|
let the unique heap retain hashtable entries after elements are popped to ensure uniqueness forever
|
2008-10-01 21:25:37 -05:00 |
|
Slava Pestov
|
6febd7ed4a
|
Merge branch 'master' of git://factorcode.org/git/factor
|
2008-10-01 20:55:05 -05:00 |
|
Slava Pestov
|
4ce980b9ac
|
Move heap-slurp-when to spider
|
2008-10-01 20:54:58 -05:00 |
|
Doug Coleman
|
32b3fab3a9
|
assoc-deques -> assoc-heaps
|
2008-10-01 20:48:53 -05:00 |
|
Doug Coleman
|
ebe8adfe31
|
spruce up the spider
|
2008-10-01 19:29:18 -05:00 |
|
Doug Coleman
|
723cd453a7
|
initial checkin or spider
|
2008-10-01 18:17:31 -05:00 |