This study evaluated ChatGPT versions 3.5, 4, and 4 with visual input using 12 questions about six kidney transplant cases. It compared model performance with the group-majority answers of nephrology fellows, fellowship program directors, and a Kidney Week audience.
GPT-4 with visual input correctly answered 10 of the 12 questions. The study provides an early, small-scale benchmark of specialized clinical reasoning.