Automated Excel-to-R Conversion of Health Economic Models Using the REEEVR Tool: Results of Alpha Test

Obectives:
Perform alpha test of the Reliable and Efficient Estimation of the Economic Value of medical Research (REEEVR) Excel-to-R conversion software on models developed by academia, industry consulting and HTA agencies.

Methods:
REEEVR performs automated Excel-to-R conversion by parsing an input Excel file, generating abstract syntax trees for each cell, converting the cell into R, then reconstructing the program fully in R. We recently finished a closed alpha trial, where we invited potential users from across academia and industry to evaluate the software and submit feedback. As part of this process, extensive logging was performed, with these logs being requested from each participant to allow for further development of the REEEVR tool. To achieve a wide variety of users, the use of both informal networks and social media via LinkedIn were used.

Results:
We sent invitations to 24 people, of which 9 responded with the requisite logs and feedback. Of those that responded, all participants tested the tool on multiple Excel documents, providing 20 log files for a variety of Excel models. Of those models tested, only one model successfully converted and ran. Reasons for unsuccessful conversion fall into three categories: Missing function implementations, custom function implementations, unexpected but consistent crash of the tool. We identified 32 unique functions which, if implemented, would likely allow successful conversion of most models included in the alpha test.

Conclusions:
We found significant interest in the social media space and informal networks for this tool, however, participation in the study is limited to those with time and inclination to work with a tool with known and unknown issues. The feedback from the alpha test has allowed us to pivot development, which we expect will allow a beta test to be performed in November of 2025, which we predict will have significantly better conversion ratios.