Master’s Thesis Presentation • Systems and Networking • CLPush: Proactive Cache Transfers in NUMA Applications

Please note: This master’s thesis presentation will take place in DC 3317 and online.

Gautam Pathak, Master’s candidate
David R. Cheriton School of Computer Science

Supervisor: Professor Trevor Brown

Modern NUMA systems support a thread count of as much as 128 threads to support high performance applications. These systems usually employ a scalable cache coherent directory based mechanism to ensure that the most up-to-date data is passed around in all the cores. It is common to use invalidate-based protocols in such systems. NUMA applications incur a lot of overhead due to data not being present in a particular socket’s cache and having to fetch it from a cache in another socket. For example, in applications such as the producer consumer problem, when threads reside in two different clusters, having to consumer data from a socket different than where data is produced can be extremely expensive.

This occurs due to coherence messages having to cross the sockets as and when the consumer threads require the shared data. In this thesis, I present a cache manipulation instruction coined \textit{CLPush}, which proactively transfers data across to a predetermined destination, so as to reduce cache demand misses and improve performance.

The optimisation is presented as an instruction hint to the processor which directs a cache to send data across to another predetermined destination. I present different variants of CLPush, which involve having one or more destinations to transfer the data to. I also discuss the potential use cases of this instruction in different applications, such as the producer-consumer problem, and Futures and Promises. I also analyse the performance of CLPush in two variants of the producer-consumer problem.

To attend this master’s thesis presentation in person, please go to DC 3317. You can also attend virtually using Zoom at https://uwaterloo.zoom.us/j/99073810406.