The rational management of young animals often involves novel situations that may cause reluctance and stress, making it essential to understand how visual stimuli influence their behavioral responses. The present study evaluated the reaction of dairy calves aged 0 to 6 months to colored mats placed at transition points between areas, considering different environments and social contexts. The research was conducted at the Federal Institute of Education, Science and Technology of Southern Minas Gerais, Muzambinho Campus, Brazil. Six Holstein calves raised in an intensive system were used, assessed both individually and in groups, in familiar (FA) and unfamiliar (UA) locations. The mats were made with horizontal interlaced stripes in lilac and red, lilac and black, and lilac and yellow, in addition to a control condition without mats. Behavioral responses were recorded using an ethogram, including the behaviors crossing, reluctant crossing, exploration, retreat, and attempt to jump, based on direct observation. Statistical analysis was performed using the nonparametric Kruskal–Wallis and Nemenyi tests. The calves showed high sensitivity to visual stimuli, with a predominance of the “reluctant crossing” behavior, even in the absence of mats (66.67% in FA). The yellow–lilac mat elicited the highest frequency of this behavior (100% in group and 94.44% individual in FA), followed by the red–lilac (70.06%) and black–lilac (58.69%) mats. The red–lilac and black–lilac combinations also induced exploratory and retreat behaviors, especially under individual conditions in UA, suggesting perception of depth and uncertainty in response to contrasts. The presence of conspecifics significantly increased the likelihood of crossing, highlighting the gregarious effect. It is concluded that young calves display more cautious and exploratory responses to contrasting visual stimuli and that visual and social factors should be considered in management practices to promote safety and animal welfare.