Claudio Spiess

PhD Student, Computer Science

cvspiess at ucdavis dot edu
DECAL Lab
University of California, Davis
Davis, CA

Bio

Hey there! I’m Claudio 👋🏼 I’m a graduate student researcher at the University of California, Davis. I am a data scientist 🔮 with an emphasis on neural Natural Language Processing. I’m advised by Prof. Prem Devanbu, and am part of the DECAL Lab, which ranks as the 7th strongest software engineering research group (as of Feb. 2023) in the US. My research interests revolve around how machine learning techniques, mostly from the NLP world, can understand source code, and to a greater extent, software engineering. In particular, most of my work is focused on applying LLMs (Large Language Models) to source code.

From model “understanding”, we can do useful things like program generation from natural language, automated bug fixing, automated documentation, anomaly detection (bugs!), reverse engineering, naming, among many others. Not only do I seek to build systems, but to investigate metaphysical questions: do LLMs understand code? What do they learn? What biases and problems do these approaches have? And most importantly, how to fix them? On the practical side, I’m interested in how cognitive load can be alleviated while writing software by smart tools for programmers.

Previously, I helped build a data driven lending platform at Dutch FinTech startup Floryn as a full stack software engineer, making machine learning work for loans. Most processes had some form of machine learning algorithms backing them, so I built some interesting tools around this, such as interpretation & explanation tools for non-technicals.

I received my bachelor degree in Computer Science & Engineering from the Free University of Bolzano. I wrote a research thesis, concentrating on NLP for software engineering, under the supervision of Dr. Romain Robbes and Dr. Andrea Janes. During this time, I was affiliated with the Software and Systems Engineering (SwSE) research group.

When I’m not hacking around on code or models, I like to travel the world with a backpack (44 countries/territories and counting), scuba dive (113 dives and counting), and hike volcanoes. I also speak six languages: English, German, French, Dutch, Italian, and some Spanish.

Projects

STraceBERT: Source Code Retrieval using Semantic Application Traces paper illustration

Claudio Spiess
STraceBERT: Source Code Retrieval using Semantic Application Traces

FSE 2023,2021-2023

Novel approach that utilizes a Java dynamic analysis tool to record calls to core Java libraries, and a BERT-style model on the recorded application traces for effective method source code retrieval from a candidate set. Experiments demonstrate the effectiveness in retrieving the source code compared to existing approaches. Proposed approach offers a promising solution to the problem of code retrieval in software reverse engineering and opens up new avenues for further research in this area.

FSE

Method Name Suggestions: An Open Vocabulary Approach paper illustration

Claudio Spiess Romain Robbes Andrea Janes
Method Name Suggestions: An Open Vocabulary Approach

Bachelor Thesis,2019

Performed a series of experiments evaluating architectural and data preprocessing changes on the accuracy of the names produced by the STOTA code2seq model. We found that BPE can successfully be applied for method naming, resulting in model performance up to 4.2 F1 points higher than baseline

ResearchGate

Universal Transformer: Towards Learned Positional Encodings paper illustration

Claudio Spiess Baris Sen David Gayda Stefan Broeger
Universal Transformer: Towards Learned Positional Encodings

Class Project,2022

A novel pretraining approach for architecture and modality agnostic Transformer positional embeddings.