The CPU carries out computer program instructions and performs basic operations. It contains a microprocessor with transistors and wires that control the computer's activities by interacting with other components on the motherboard. There are two types of memory: RAM is volatile and can lose data when powered off, while ROM is non-volatile and retains data when off. The motherboard is the main circuit board that holds crucial components like the CPU and memory, and provides connections for peripherals.