Because of having no opportunity of higher education for women of surrounding unions: Gala, Chala, Balla, Gopinathpur, Ramkrishnapur, Kanchanpur, Shimulia, Arua and Nalee, the renowned figures of the above mentioned localities arranged a meeting on March 18, 1994 inorder to discuss about the necessity of the establishment of a women college at Jhitka. The remarkable figures who attended the meeting are- Mr. Taleb Hossain, Abdur Rouf Akand, Rahmat Ali Master, Lutfar Rahman, Rafiqul Islam(Mukul), Advocate Kayes Uddin Bhuyan, Md. Billal Hossain Khan, Bulbul Ahmed, Doctor Abdullah Al-Mamun and 50/60 more renowned figures of the locality.
Afterwards at one point of discussion about the location and fund for the establishment of the college Mr. Rahamt ALi Master Proposed that Advocate Khaja Md. Rahmat Ali would be the founder of the college and the will be named after his name. He also argued that Advocate Khaja Rahmat Ali worked hard for the establishment of “Jhitka Bahumikhi Girls School”. He worked as the founder secretary of the school and then he becomes the Chairman of the school. He also has a lot of contribution to social welfare activities. On March 23, 1994 another meeting was held at Jhitka Ananda Mohan Bahumukhi High School presided over by Mr. Taleb Hossain, the founder Chairman of “Jhitka Women College.” Advocate Khaja Rahmat Ali was present there. He agreed to donate three acres of land of the both sides of the college and promised to provide with all other necessary requirements. In the meeting was unanimously decided that the college will be named after Advocate Khaja Md. Rahmat Ali. According to the decision of the meeting, the activities of the college was started temporarily at “Jhitka Ananda Mohan Bahumukhi High School.” It was noticed that the expected number of students did not get admitted into the college and the issue was discussed in the meeting of the managing committee held on 25 November, 1994. The committee unanimously decided that the name of the college will be “Jhitka Khaja Rahmat Ali college”. In 1995 the activities of the college was shifted from temporary office to its own campus.
The founder funded taka more than 21 lakh per law on different dates and so the Deputy Commissioner of Manikganj District granted the name of the college according to recommend Aton and approved the process of admission after scrutinizing. Overcoming a lot of barriers the college continued to go ahead and got the first approval in 1996. By dint of disciplined management the college got affiliation in 1998 and it got M.P.O(H.S.C) in 2000. It abtained affiliation for Degree Course on B.A, B.S.S and B.B.S in 2001 following M.P.O(Degree) in 2002. The College got approval of H.S.C(Business Management) on (1) Computer Operation (2) Secretarial Science under the curriculum of Bangladesh Technical Education Board in 2003. The section got M.P.O in 2010. Recently the college has able to establish its position as one of the renowned institutions of this Thana even in Manikganj district.