Key ingredients to achieve effective 1/O 4 asycop nct caching c/e Key ingredients to achieve effective l/O Sebastien Ponce sebastien.ponce@cern.ch CERN Thematic CERN School of Computing 2018 1/57 S.Ponce-CERN
Key ingredients to achieve effective I/O 1 / 57 S. Ponce - CERN async IOopt struct caching c/c Key ingredients to achieve effective I/O S´ebastien Ponce sebastien.ponce@cern.ch CERN Thematic CERN School of Computing 2018
Key ingredients to achieve effective 1/O 4，yme0op时nct caching c/c In the previous episodes... o We've found out how to store data efficiently o And how to distribute it o We've learnt how to detect data corruptions o And made sure our data was safe and consistent 2/57 S.Ponce-CERN
Key ingredients to achieve effective I/O 2 / 57 S. Ponce - CERN async IOopt struct caching c/c In the previous episodes... We’ve found out how to store data efficiently And how to distribute it We’ve learnt how to detect data corruptions And made sure our data was safe and consistent Today How do we use them ? Efficiently
Key ingredients to achieve effective 1/O syme 0opt snict caching c/e “ In the previous episodes... o We've found out how to store data efficiently o And how to distribute it o We've learnt how to detect data corruptions o And made sure our data was safe and consistent Today How do we use them Efficiently 2/57 S.Ponce-CERN
Key ingredients to achieve effective I/O 2 / 57 S. Ponce - CERN async IOopt struct caching c/c In the previous episodes... We’ve found out how to store data efficiently And how to distribute it We’ve learnt how to detect data corruptions And made sure our data was safe and consistent Today How do we use them ? Efficiently
Key ingredients to achieve effective 1/O ye I(op nct caching c/e Outline ① Asynchronous 1/O Latency Asynchronous l/O interfaces ●Message queues 2 I/O optimizations Optimizing network transfers Optimizing local transfers Influence of data structures on I/O o Measuring I/O efficiency of algorithms Caching o Principles Policies ●Distributed Caches 3 Conclusion 3/57 S.Ponce-CERN
Key ingredients to achieve effective I/O 3 / 57 S. Ponce - CERN async IOopt struct caching c/c Outline 1 Asynchronous I/O Latency Asynchronous I/O interfaces Message queues 2 I/O optimizations Optimizing network transfers Optimizing local transfers 3 Influence of data structures on I/O Measuring I/O efficiency of algorithms 4 Caching Principles Policies Distributed Caches 5 Conclusion
Key ingredients to achieve effective 1/O 4心async0op时anet caching c/e Asynchronous 1/O ①Asynchronous I/O Latency Asynchronous l/O interfaces ·Message queues ②l/0 optimizations Influence of data structures on 1/O Caching Conclusion tancy ac mi名 4/57 S.Ponce-CERN
Key ingredients to achieve effective I/O 4 / 57 S. Ponce - CERN async IOopt struct caching c/c latency async msgQ Asynchronous I/O 1 Asynchronous I/O Latency Asynchronous I/O interfaces Message queues 2 I/O optimizations 3 Influence of data structures on I/O 4 Caching 5 Conclusion