Link Search Menu Expand Document (external link)


Our core project team includes Jonathan Bell, Christopher Timperly, Michael Hilton, Lauren Herckis, and Joshua Sunshine. This project represents the evolution of our studies of the challenges in artifact sharing [ESE 21], community work within ACM SIGSOFT, experiences as artifact co-chairs [PLDI 20], research in continuous integration [MSR 20, ESEC/FSE 19, MSR 18, ESEC/FSE 17, ASE 16], and experiences creating many large-scale software engineering experiments [ICSE 22, ICSE 21, OOPSLA 20, ASE 18, ICSE 18].

Our prototypes for are made possible thanks to close collaborations with Northeastern’s Research Computing and Khoury Systems groups, who have provided technical expertise and hardware.

Our ultimate goal is to create a community resource to share resuable continuous integration workflows and actions, allowing researchers to quickly create large-scale evaluation scripts that can run on existing cloud or on-premises resources. We will build template workflows for common evaluation methodologies and datasets, allowing researchers to focus on designing and building their tools, rather than designing and building reusable artifacts for evaluating their tools. We hope to have more to share soon. In the meantime, if you are interested in collaborating on this project, please reach out to us at