Libtrace Updates Parallelisation 7012022 Whats new Zero Copy

Libtrace Updates Parallelisation 7/01/2022

What’s new - Zero Copy Formats • Linux socket PACKET_MMAP (ring: ) • Intel Data Plane Development Kit (dpdk: ) Polling Libtrace User Space Kernel DMA NIC PACKET_MMAP - https: //www. kernel. org/doc/Documentation/networking/packet_mmap. txt DPDK - http: //intel. com/go/dpdk NTOP DNA - http: //www. ntop. org/products/pf_ring/dna/ © THE UNIVERSITY OF WAIKATO • TE WHARE WANANGA O WAIKATO

More Speed Now working on parallelisation © THE UNIVERSITY OF WAIKATO • TE WHARE WANANGA O WAIKATO

Operation outline Specific to each format Hash fn Parallel stream format Thread 1 Packets Messages Thread 3 Libtrace User code Control Messages © THE UNIVERSITY OF WAIKATO • TE WHARE WANANGA O WAIKATO Parallel Per Packet fn Results (void *) • Packets • Summary data Optional Messages Reduce Report Result

Operation outline fallback Libtrace handles this Single stream format (such as a file) Thread 1 Per Packet fn Hash fn Specific to each format Parallel Thread 2 Per Packet fn User or libtrace provides Thread 3 Per Packet fn © THE UNIVERSITY OF WAIKATO • TE WHARE WANANGA O WAIKATO

Key Points • Threading handled • Messaging system • Bi-directional flows (TCP, UDP) Same thread • Blocking/Non-Blocking modes • Useful reduce functions • Re-ordering packets (or other types results) • Realtime results (Results every X seconds) • Single sorted result • Fast single threaded path © THE UNIVERSITY OF WAIKATO • TE WHARE WANANGA O WAIKATO

API Comparison trace_create() trace_pstart() reporter{} trace_create_packet() trace_start() per_pkt() per_pkt{} trace_read_packet() per_pkt{} trace_get_results() trace_publish_result() trace_join() trace_destroy() © THE UNIVERSITY OF WAIKATO • TE WHARE WANANGA O WAIKATO trace_destroy()

Hardware support Nowadays most high speed NICs support Microsoft’s receive side scaling (RSS). • Toeplitz hashing • Not bi-direction (commutative) hash • But given special key can be Toeplitz - http: //msdn. microsoft. com/en-us/library/windows/hardware/ff 570725%28 v=vs. 85%29. aspx © THE UNIVERSITY OF WAIKATO • TE WHARE WANANGA O WAIKATO

WAND Network Research Group Department of Computer Science The University of Waikato Private Bag 3105 Hamilton, New Zealand www. crc. net. nz www. wand. net. nz www. waikato. ac. nz © THE UNIVERSITY OF WAIKATO • TE WHARE WANANGA O WAIKATO