Autism spectrum disorder (ASD) is a heterogeneous neuropsychiatric problem with a few core symptoms: weaknesses in social behavior, verbal impairments, repetitive behavior and restricted interests. Beyond the core symptoms, autism has strong association with other disorders such as intellectual disability, epilepsy, schizophrenia among many others. This paper outlines a theory of ASD with capacity to connect heterogeneous ‘core’ symptoms, medical and psychiatric comorbidities as well as other etiological theories of autism in a unifying cognitive framework rooted in neuroscience and genetics. Cognition is embedded into an ever-developing structure modified by experiences, including the outcomes of environment influencing behaviors. We introduce the hypothesis that autism is caused by deficits in component-based cognition and the internal learning reinforcing machinery. Specifically, we outline our Cartesian Factor forming autoencoder like model that supports cognition by breaking combinatorial explosion and discuss the cognitive and neural processes behind our model. The high dimensionality of sensory information poses serious problems, since the brain can handle only 7±2 relevant variables at a time making processes, such as the extraction and encoding of the relevant variables and their efficient manipulation critical. These processes are influenced by previous experiences and the internal reward system. In addition, large delays of distributed information processing should be counteracted by learned predictive models to synchronize sensory, proprioceptive, and cognitive signals and have timely and accurate model-based actions. Impairments in any of these aspects may disrupt learning and execution. Combinations of small impairments may allow the solving of low complexity tasks but may become visible if learned variables and the related metric are improper and imprecise, respectively, especially if their number is large. We claim that social interactions are amongst the most challenging cognitive tasks in terms of the number of variables involved. In turn, they are highly susceptible to combinations of small impairments. We consider impairments as the basic colors of autism, whereas the combinations of diverse impairments make the palette of autism. In turn, social processes can be spoiled in many ways and can lead to diverse comorbidities.