summaryrefslogtreecommitdiff
path: root/calculate_average_gnabyl.sh
AgeCommit message (Collapse)Author
2024-01-13[Attempt #2] String overflow hash + data/mem optimization (#356)Bang NGUYEN
* Use graal * Use dynamic cores computer * Use stream API to cleanup code * Use max processors * Use hash to avoid init string * optimize concurrentmap init * Smaller hash size * Avoid checking concurrentmap * Optimize data type * string dedup * Faster write * Change base * Remove time * Use mul instead of div
2024-01-12[Attempt 1] Memory mapping + split by linebreak + multithreads + fast double ↵Bang NGUYEN
parser (#330) * Create clones * Cleanup code and add memory mapping to read file * Fix chunks reading logic to fit linebreak * Remove unused * Sequential * Multi thread process chunks * Add new line in output * Remove unnecessary operation with map & reducer memory * Reduce mem usage by using only 1 map * formatting * Remove unnecessary length check * Remove trycatch * Optimize double parsing