steve
/
factor
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

cuckoo-filters: change language to refer to fingerprints.

char-rename
John Benediktsson 2016-08-08 17:01:53 -07:00
parent eebdf93e45
commit c09cfd586c
1 changed files with 17 additions and 17 deletions
extra/cuckoo-filters

34
extra/cuckoo-filters/cuckoo-filters.factor
View File

@ -16,7 +16,7 @@ CONSTANT: max-cuckoo-count 500
! The maximum load factor we allow before growing the capacity ! The maximum load factor we allow before growing the capacity
CONSTANT: max-load-factor 0.96 CONSTANT: max-load-factor 0.96
! The number of tags to store in each bucket ! The number of fingerprint to store in each bucket
CONSTANT: bucket-size 4 CONSTANT: bucket-size 4
: #buckets ( capacity -- #buckets ) : #buckets ( capacity -- #buckets )
@ -26,14 +26,14 @@ CONSTANT: bucket-size 4
: <cuckoo-buckets> ( capacity -- buckets ) : <cuckoo-buckets> ( capacity -- buckets )
#buckets [ bucket-size f <array> ] replicate ; #buckets [ bucket-size f <array> ] replicate ;
: tag-index ( hash -- tag index ) : hash-index ( hash -- fingerprint index )
4 over <displaced-alien> [ uint deref ] bi@ ; 4 over <displaced-alien> [ uint deref ] bi@ ;
: alt-index ( tag index -- altindex ) : alt-index ( fingerprint index -- alt-index )
[ 0x5bd1e995 w* ] [ bitxor ] bi* ; [ 0x5bd1e995 w* ] [ bitxor ] bi* ;
: tag-indices ( bytes cuckoo-filter -- tag i1 i2 ) : hash-indices ( bytes cuckoo-filter -- fingerprint index alt-index )
checksum>> checksum-bytes tag-index 2dup alt-index ; checksum>> checksum-bytes hash-index 2dup alt-index ;
: bucket-lookup ( fingerprint bucket -- ? ) : bucket-lookup ( fingerprint bucket -- ? )
member? ; member? ;
@ -55,41 +55,41 @@ TUPLE: cuckoo-filter buckets checksum size ;
<cuckoo-buckets> sha1 0 cuckoo-filter boa ; <cuckoo-buckets> sha1 0 cuckoo-filter boa ;
:: cuckoo-insert ( bytes cuckoo-filter -- ? ) :: cuckoo-insert ( bytes cuckoo-filter -- ? )
bytes cuckoo-filter tag-indices :> ( tag! i1 i2 ) bytes cuckoo-filter hash-indices :> ( fp! i1 i2 )
cuckoo-filter buckets>> :> buckets cuckoo-filter buckets>> :> buckets
buckets length :> n buckets length :> n
{ {
[ tag i1 n mod buckets nth bucket-insert ] [ fp i1 n mod buckets nth bucket-insert ]
[ tag i2 n mod buckets nth bucket-insert ] [ fp i2 n mod buckets nth bucket-insert ]
} 0|| [ } 0|| [
cuckoo-filter [ 1 + ] change-size drop t cuckoo-filter [ 1 + ] change-size drop t
] [ ] [
2 random zero? i1 i2 ? :> i! 2 random zero? i1 i2 ? :> i!
max-cuckoo-count [ max-cuckoo-count [
drop drop
tag i n mod buckets nth bucket-swap tag! fp i n mod buckets nth bucket-swap fp!
tag i alt-index i! fp i alt-index i!
tag i n mod buckets nth bucket-insert fp i n mod buckets nth bucket-insert
dup [ cuckoo-filter [ 1 + ] change-size drop ] when dup [ cuckoo-filter [ 1 + ] change-size drop ] when
] find-integer >boolean ] find-integer >boolean
] if ; ] if ;
:: cuckoo-lookup ( bytes cuckoo-filter -- ? ) :: cuckoo-lookup ( bytes cuckoo-filter -- ? )
bytes cuckoo-filter tag-indices :> ( tag i1 i2 ) bytes cuckoo-filter hash-indices :> ( fp i1 i2 )
cuckoo-filter buckets>> :> buckets cuckoo-filter buckets>> :> buckets
buckets length :> n buckets length :> n
{ {
[ tag i1 n mod buckets nth bucket-lookup ] [ fp i1 n mod buckets nth bucket-lookup ]
[ tag i2 n mod buckets nth bucket-lookup ] [ fp i2 n mod buckets nth bucket-lookup ]
} 0|| ; } 0|| ;
:: cuckoo-delete ( bytes cuckoo-filter -- ? ) :: cuckoo-delete ( bytes cuckoo-filter -- ? )
bytes cuckoo-filter tag-indices :> ( tag i1 i2 ) bytes cuckoo-filter hash-indices :> ( fp i1 i2 )
cuckoo-filter buckets>> :> buckets cuckoo-filter buckets>> :> buckets
buckets length :> n buckets length :> n
{ {
[ tag i1 n mod buckets nth bucket-delete ] [ fp i1 n mod buckets nth bucket-delete ]
[ tag i2 n mod buckets nth bucket-delete ] [ fp i2 n mod buckets nth bucket-delete ]
} 0|| } 0||
dup [ cuckoo-filter [ 1 - ] change-size drop ] when ; dup [ cuckoo-filter [ 1 - ] change-size drop ] when ;