AlloyEval
A course project replicating and extending an evaluation of LLM-generated Alloy specifications.
AlloyEval studies how language models generate Alloy formal specifications. It reproduces and extends the public study by Hong et al. with additional task variants and a report.
The full report documents the task variants, experiments, and results.