Common pitfalls when using sys.base_exec_prefix and sys.base_prefix include forgetting to activate virtual environments, leading to unintended use of global packages. Ensure correct environment activation, check prefixes, and manage installations with pip carefully. Create isolated environments and maintain consistency with requirements files for better project management.