Reading:
Writing:
Reading:
machine learning: https://homes.cs.washington.edu/~pedrod/papers/cacm12.pdf
self-supervised learning: https://ai.meta.com/blog/self-supervised-learning-the-dark-matter-of-intelligence/
Writing: (1-2 paragraphs) pick one of the key lessons in the reading, and describe concretely what it would mean for GPT-5.
Read:
In Defense of Logic: https://www.ijcai.org/Proceedings/77-1/Papers/099.pdf
In Defense of Probability: https://www.ijcai.org/Proceedings/85-2/Papers/064.pdf
Write: What do you think should be the representation language (or “language of thought”) for a human-level AI system? Why? (1-2 paragraphs)
Reading (skimming the article is ok): Artificial Intelligence meets Natural Stupidity https://www.inf.ed.ac.uk/teaching/courses/irm/mcdermott.pdf
Writing: What points in this article (if any) are applicable to LLMs? (1-2 paragraphs)
Reading: COMPUTER SCIENCE AS EMPIRICAL INQUIRY: SYMBOLS AND SEARCH https://iiif.library.cmu.edu/file/Newell_box00024_fld01660_doc0003/Newell_box00024_fld01660_doc0003.pdf
Writing: How might Geoff Hinton disagree? How might Jon McCarthy disagree? What do you think? (3 paragraphs in total)
Read 2006: (original CACM article) https://www.cs.cmu.edu/~15110-s13/Wing06-ct.pdf
OR2010: http://www.cs.cmu.edu/~CompThink/papers/TheLinkWing.pdf
Write up: What would be instances of “AI thinking”?
Read Wolfram: https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/
ORhttps://arxiv.org/abs/2311.17301
Write up: what are 3-5 key AI ideas (in a short phrase) how do they manifest in GPT?