Internet2 and ESNet Technology Exchange

The annual Technology Exchange is a premier technical event in the global research and education community, convening chief technologists, scientists, engineers, architects, operators and students from around the globe. The Globus team is participating in multiple sessions and will be available to discuss how campuses are building research data management solutions using Globus.

Science Gateways–Novel Technologies Enhance Usability for Research Communities

Tuesday, October 28, 4:15-5:00PM

Speaker: Rachana Ananthakrishnan

Rachana will participate in a panel discussion with representatives leading the development of new technologies in the context of science gateways and representing diverse research communities. A science gateway provides researchers with access integrated and distributed sets of tools, applications, and data collections for a specific research domain. Such gateways are evolving to serve multiple domains, facilitating collaborations that span multiple disciplines. Research teams are beginning to leverage new methods of virtualization, standard APIs, and hosted services designed to provide access to distributed resources that scale to meet the needs of data-intensive science. Rachana will describe how technologies such as Globus can be used as the foundation for science gateways and web applications to support research data management at scale.

High-performance Distributed Data Management on Terabit Networks

Thursday, October 30, 9:15-10:00AM

Speaker: Raj Kettimuthu

As the advanced 100G networks have been deployed in Internet2 and ESnet, numerous opportunities for new research into high-performance distributed data management on terabit networks have also emerged. This situation is promising in that high-speed networks can expedite the data exchange among research institutions distributed over long distances, thereby reducing the time to solution of scientific computing. The Globus file transfer service has become the de facto standard for data exchange among distributed sites in research communities. Many studies related to Globus have been conducted to improve performance of data movements over wide-area networks, and much better performance has been achieved as compared with the standard FTP protocol and other traditional data transfer tools such as scp. However, data growth is outpacing network bandwidth, requiring additional data management computations to reduce data rates (e.g., compression) and parallel network resource allocations (e.g., multiple network paths). In addition, many data flows with various quality-of-service (QoS) requirements would fail to meet their requirements without proper management frameworks. This session will discuss:

• How to sustainably saturate 100G or 1T links for diverse data flows.
• The end-system, storage, and network challenges in scaling end-to-end transfers beyond 100G
• Scheduling multiple flows such that their QoS requirements are met and overall throughput is maximized.
• Accounting for the overall workflow (and related computations if data flows are parts of the scientific workflow) and assigning compute resources in accordance with data flows.
• The frameworks needed and the design principles for future data movement services.