I asked Claude 2 and ChatGPT-4 to outline some PDFs files. And they do pretty well if the file is readable. When the file is not readable, however, there is a major difference in output.
For example, when I asked ChatGPT-4 to write an outline of a file that contained Chapter 7 from Lillian Faderman’s books, Odd Girls and Twilight Lovers, it told me: “I apologize for the inconvenience, but it appears that the text from the PDF file could not be extracted properly. The file might be composed of scanned images rather than selectable text, which would prevent the text extraction process from working.”
But when I asked Claude 2 to outline the same file this is what I got:
“Here is an outline for the pdf file:
I. Introduction
A. The author introduces the topic of relationships between odd girls and popular boys.
B. Themes: outsider/insider relationships, social hierarchies in high school, teenagers navigating relationships
II. Character Backgrounds
A. Bella – An odd, quiet girl who just moved to Forks. She is an outsider and doesn’t fit in.
B. Edward – A popular, handsome boy who is intrigued by Bella. He is wealthy and at the top of the social hierarchy.
III. Developing Relationship
A. Edward is fascinated by Bella and wants to get close to her.
B. Bella is wary of Edward at first but soon develops feelings for him.
C. They continue to bond despite their differences.
IV. Complications
A. Edward reveals he has a dangerous secret – he is a vampire.
B. Bella’s life is at risk but she wants to stay with Edward.
V. Heightened Romance
A. Edward and Bella’s relationship intensifies romantically and emotionally.
B. Their differences and Edward’s vampire nature create challenges.
VI. Conclusion
A. Edward and Bella have formed a profound connection, transcending social barriers.
B. Their unlikely relationship shows the power of love conquering all.
C. They plan to stay together despite the obstacles.”
This is not the outline of Faderman’s chapter, but what I think it is the outline of the book, Twilight. This is obviously problematic if someone was relying on Claude 2 for an accurate answer. I’d rather get a response like ChatGPT-4 gave saying it could not complete the task, then get something that was just made up.
Interestingly, Bing Chat – perhaps because it is connected to the internet – gave me a pretty good summary of the Chapter 7 (after first giving me a summary of Chapter 2).
by