delex.storage.hash_map package¶
Submodules¶
delex.storage.hash_map.hash_map_base module¶
- class delex.storage.hash_map.hash_map_base.DistributableHashMap(arr)¶
Bases:
SparkDistributable- deinit()¶
deinitialize the object, closing resources (e.g. file handles)
- delete()¶
- init()¶
initialize the object to be used on in a spark worker
- property on_spark¶
- size_in_bytes() int¶
- to_spark()¶
send the obj to the spark cluster to be used on spark workers
delex.storage.hash_map.id_int_map module¶
- class delex.storage.hash_map.id_int_map.IdOffsetHashMap(arr)¶
Bases:
DistributableHashMap- classmethod build(longs, ints, load_factor=0.5)¶
- delex.storage.hash_map.id_int_map.hash_map_get_key(arr, key)¶
- delex.storage.hash_map.id_int_map.hash_map_get_keys(arr, keys)¶
- delex.storage.hash_map.id_int_map.hash_map_insert_key(arr, key, val)¶
- delex.storage.hash_map.id_int_map.hash_map_insert_keys(arr, keys, vals)¶
delex.storage.hash_map.string_int_map module¶
- class delex.storage.hash_map.string_int_map.StringIntHashMap(arr, hash_func)¶
Bases:
DistributableHashMap- classmethod build(strings, ints, load_factor=0.5)¶