In this study, we present a groundbreaking approach to aspect-based sentiment analysis (ABSA) using transformer-based models. ABSA is essential for understanding the intricate nuances of sentiment expressed in text, particularly across diverse linguistic and cultural contexts. Focusing on movie reviews in Hausa, a language under-represented in sentiment analysis research, we propose HauBert, a biredirectional transformer-based approach tailored for aspect and polarity classification, by fine-tuning a pre-trained mBert model. Our work addresses the scarcity of resources for sentiment analysis in under-represented languages by creating a comprehensive Hausa ABSA dataset. Leveraging this dataset, we preprocess the text using state-of-the-art transformer techniques for feature extraction, enhancing the model's ability to capture nuanced aspects of sentiment. Furthermore, we manually annotate aspect-level feature ontology words and sentiment polarity assignments within the reviewed text, enriching the dataset with valuable semantic information. Our proposed transformer-based model utilizes self-attention mechanisms to capture long-range dependencies and contextual information, enabling it to effectively analyze sentiment in Hausa movie reviews. The proposed model achieves significant accuracy in aspect term extraction and sentiment polarity classification, with scores of 96% and 94%, respectively, outperforming traditional machine models. This demonstrates the transformer's efficacy in capturing complex linguistic patterns and sentiment nuances. Our study not only advances ABSA research but also contributes to a more inclusive sentiment analysis landscape by providing resources and models tailored for under-represented languages.