The Finance AI Challenge: An Evaluation of the Top Six Free Web-based AI Models
David Krause (Marquette University)
June 2024
This article evaluates six free web-based AI models-ChatGPT, Gemini, Copilot, Claude, Perplexity, and Meta AI-in their performance on finance-related tasks. Utilizing a structured approach, we assessed the models’ abilities to handle factual, conceptual, and computational queries, as well as their proficiency in Python coding through a financial case study. Our findings indicate that ChatGPT, Copilot, and Perplexity consistently excelled, particularly in delivering accurate, comprehensive, and well-structured responses. However, challenges such as maintaining context, ensuring factual accuracy, and mitigating biases persist. The study underscores the need for future research to enhance domain adaptation, explainability, and ethical considerations to ensure reliable and responsible use of AI models in finance.
Monthly Archives: July 2024
Macro Briefing: 18 July 2024
* Fed Gov. Waller says central bank ‘getting closer’ to an interest rate cut
* US Q2 GDP nowcast revised up to +2.7% vs. 1.4% in Q1 via GDPNow model
* Federal Reserve’s Beige Book suggests economy is slowing
* US industrial production rose more than expected in June
* US housing starts rose in June, but remain near 2-year low:
US GDP Nowcast Reflects Slow Growth For Upcoming Q2 Report
US economic activity is on track to remain slow in this month’s second-quarter GDP report. The expansion is expected to continue via the government’s data, but today’s revised nowcast for Q2 suggests that output will remain more or less comparable to Q1’s modest increase, based on the median estimate for a set of projections compiled by CapitalSpectator.com.
Macro Briefing: 17 July 2024
* IMF lowers its 2024 economic growth forecast for US
* A new era for the US dollar may arrive with a Trump-Vance administration
* Trump says, as president, he would let Fed Chair Powell to finish his term
* US homebuilder sentiment falls in July to lowest level since December
* US retail spending was flat in June, but…
* Retail sales ex-autos rise 0.4%, biggest monthly gain since April:
Will A Goldilocks Economy Keep The Stock Market Humming?
If the S&P 500 flatlines from current levels through Dec. 31, 2024, the market would still go into the history books as delivering yet another strong year on the basis of an 18.1% year-to-date rise through Monday (July 15). But the best may be yet to come, some Wall Street firms predict.
Macro Briefing: 16 July 2024
* Recent inflation data ‘add somewhat to confidence’ for rate cuts: Powell
* Biden set to call for 5% cap on rent increases
* Wall Street expecting approval of ethereum ETFs
* Demand for safety supports gov’t bonds despite deteriorating gov’t finances
* NY Fed manufacturing activity index continues to decline in July:
Markets Confident That Rate Cuts Will Start In September
We’ve been here before. Markets price in high odds that the Federal Reserve will soon start cutting interest rates only to learn otherwise. Is this time different? That’s the bet… again.
Macro Briefing: 15 July 2024
* How might Trumponomics influence the US economy?
* China’s economy slows in Q2 to softest annual pace in five quarters
* Higher interest rates take a toll on earnings at big banks
* What’s the source of portfolio alpha? Behavioral risk a key factor
* Kuwait announces discovery of “gigantic oil field”
* US consumer sentiment drops for second month in July to 8-month low:
Book Bits: 13 July 2024
● Shocks, Crises, and False Alarms: How to Assess True Macroeconomic Risk
Philipp Carlsson-Szlezak and Paul Swartz
Excerpt via Harvard Business Review
In 2022, when U.S. interest rates climbed, a cascade of emerging-market defaults were predicted—but they didn’t materialize. Also in 2022, and again in 2023, public discourse cast an imminent recession as “inevitable.” Instead a resilient U.S. economy not only defied the doomsayers but delivered strong growth.
For executives and investors such whiplash comes with two types of costs: financial and organizational. Consider the financial cost to automakers that reduced their semiconductor orders in 2020 because they misread the Covid-19 recession as a protracted economic depression. That meant they missed out on sales during the roaring recovery. And leaders can lose the trust of their organizations if they overreact to false alarms with abrupt reversals in strategy, operations, and communications. Clearly, getting the macro call right really matters.
10-Year US Treasury Yield ‘Fair Value’ Estimate: 12 July 2024
The spread between the US 10-year Treasury yield vs. a ‘fair value’ estimate calculated by CapitalSpectator.com narrowed to a three-month low in June. The market-based yield is still well above this fair value estimate, but as expected in recent months (see here, for instance) the excessive market premium is still expected to slide.