The Finance AI Challenge: An Evaluation of the Top Six Free Web-based AI Models
David Krause (Marquette University)
June 2024
This article evaluates six free web-based AI models-ChatGPT, Gemini, Copilot, Claude, Perplexity, and Meta AI-in their performance on finance-related tasks. Utilizing a structured approach, we assessed the models’ abilities to handle factual, conceptual, and computational queries, as well as their proficiency in Python coding through a financial case study. Our findings indicate that ChatGPT, Copilot, and Perplexity consistently excelled, particularly in delivering accurate, comprehensive, and well-structured responses. However, challenges such as maintaining context, ensuring factual accuracy, and mitigating biases persist. The study underscores the need for future research to enhance domain adaptation, explainability, and ethical considerations to ensure reliable and responsible use of AI models in finance.

Continue reading →

* Fed Gov. Waller says central bank ‘getting closer’ to an interest rate cut
* US Q2 GDP nowcast revised up to +2.7% vs. 1.4% in Q1 via GDPNow model
* Federal Reserve’s Beige Book suggests economy is slowing
* US industrial production rose more than expected in June
* US housing starts rose in June, but remain near 2-year low:

Continue reading →