MTBMLE

REQUEST FOR PROPOSAL For External Evaluation of MTB-MLE Project.

KALINGA INSTITUTE OF SOCIAL SCIENCES (KISS)

REQUEST FOR PROPOSAL

For External Evaluation of MTB-MLE Project.

 

Schedule of Events Tentative Date/Time Where
Solicitation Release 5th September, 2018 www.devnetjobsindia.org

http://www.mtbmle.org.in

Application receive Deadline By 5.30 P.M. Saturday 15th September, 2018 Through E-mail
RFP Interview 19th September, 2018 MTB-MLE Conference Hall, Project Building, KISS, KIIT Campus-10, Bhubaneswar, 751024
Announcement of Successful Proposer(s) through mail & telephone 22nd September, 2018 Through E-mail
Contract Execution 25th September, 2018  

 

 

Kalinga Institute of Social Sciences (KISS) is requests for submission of a detailed proposal from agency/ professional institutions/experts group/individual consultant who are technically experts with extensive experiences, have demonstrated track records of evaluation to submit a letter of intent, profiles and full proposal for conducting a three months duration external evaluation of the project “Mother-tongue Based Multilingual Education” (MTB-MLE). The intended evaluation will commence from last week of September 2018. The detailed information regarding submission of RFP is mentioned bellow.

 

1. Purpose

The Request for Proposal (RFP) seeks qualified consultants, agencies and/or researchers to initiate a midline evaluation in September 2018 for the project Mother Tongue-Based Multi-lingual Early Education (MTBMLE). The project is being implemented by Kalinga Institute of Social Sciences (KISS), supported by Bernard van Leer Foundation.

 

About Kalinga Institute of Social Sciences

 

Kalinga Institute of Social Sciences (KISS) is a residential institution for tribal children in Bhubaneswar, Odisha. . It provides free education, accommodation, career development, and healthcare services to 27,000 tribal students each year. Children are educated from Grade I to post -graduate level within KISS. The institute was founded in 1993 by Dr. Achyuta Samanta, who also founded the Kalinga Institute of Industrial Technology (KIIT).

 

The MTB-MLE project has been operational for the last five years (2013-2018). The mission of this project is to ensure that all children should have access to quality education in a language they speak and understand well i.e their mother tongue and then gradually make a transition to other languages. MTB-MLE aimed to ensure high quality early learning in KISS by initiating class room transactions in mother tongue, development of transition curriculum, training cadres of primary teachers in transacting the curriculum, developing culture specific, context relevant teaching learning materials for young children, strengthening parent-child interactions, documenting community practices.

 

Key Objectives:

 

  • Evaluate the output, outcome, and impact of the project as per the project implementation framework.
  • Identify good practices, innovative interventions and shortcomings or gaps (in terms of implementation of MTBMLE including inclusiveness and effectiveness, child friendly learning environment, participation of students, parents and community), positive effect on individual children, teachers, parents and community leaders etc. that will enable the MTBMLE initiatives to be institutionalized in KISS, Bhubaneswar.
  • Document the peer review monitoring mechanism: Asses the regular monitoring of the classroom transactions through audio visuals, (or other related media – audio tapes and CDs), and templates, feedback forms, or other formative evaluation approaches followed by the project.
  • Assess capacity of teachers: Aassessment of trained teacher’s competence through interactions, observance of classroom management techniques.
  • Assessment of quality of teacher training and its effect on the trained teachers..
  • Assess the relevance and applicability of Teaching Learning Materials (TLMs): Number and quality of teaching learning materials developed, printed, used by teachers/children and implication of the same in terms of MTBMLE.

 

The evaluation will also assess the relevance of the Language Lab, quality of trainings, training modules, instructional materials, teaching aids and equipment, internal monitoring mechanisms, learning and development outcomes of children, and scaling up the concept of Language Lab to other classrooms. It would also help evaluate the effectiveness the MTBMLE approach to improving children’s confidence and communication, improving the capacity of teachers and project team members.

2. Scope of Work

The project intends to assess the relevance and effectiveness of the project’s strategy and approaches for the achievement of the project objectives such as: Mother Tongue-Based Resource Hub, Language Lab, success in engaging stakeholders and the scope of expanding mother tongue-based early learning  program to all tribal districts in Odisha.

A high quality strategy review for the outlined scope of work will have the characteristics as mentioned below —  provide a comprehensive understanding on MTBMLE, including both the unique aspects of its effective conceptualization and implementation strategies, and highlight best practices that enhanced multilingual education and MTBMLE instructional resources for public domain to be used within and beyond KISS.

The deliverables of the evaluation report would be in English. The report should ensure high quality based on the following requirements:

  • Analytical in nature (both quantitative and qualitative)
  • Structured around issues and related findings/lessons learnt and best practices
  • Use of case studies
  • Surface constraints and challenges.

Report Submittal Instructions:

The length of the report should not exceed 40-45 pages in total (excluding the annexes). The report should be structured according to the 16 topics as follows:

  1. Executive Summary: description of the evaluation within a page limit of three to five.
  2. Project Background within two pages, including a brief account on the following aspects:
    1. Odisha & MTBMLE
    2. Kalinga Institute of Social Sciences
    3. Note on Bernard van Leer Foundation
  3. MTBMLE Resource Hub with its concept and its implementation process within two pages on the following points
    1. Conceptualization
    2. Implementation
  4. MTBMLE Language Lab (two pages)
    1. Conceptualization
    2. Implementation
  5. MTBMLE Upgraded Classroom (two pages)
    1. Conceptualization
    2. Implementation
  6. Evaluation Study (two pages)
    1. Objective of the evaluation
    2. Broad research questions to be addressed by the evaluation
    3. Evaluation methods
  7. Implementation of the Project
  • Admission of children
  • Case study
  • Language mapping
  • Baseline survey
  1. Instructional Materials: One page each against every materials developed such as:
    1. Teachers handbook: one page
    2. 35 days transition curriculum
  • Pictorial alphabet learning book (Barnabodha)
  1. Cartoon movie in 7 tribal languages
  2. Collection and compilation of tribal context specific riddles, rhymes, poems amd stories (Kahani Pedi, Kahila Dekhi, Ama Katha Ama Geeta)
  3. Multilingual tribal vocabulary book (environment specific) Ama Paribesha
  • Multilingual early Education Monitoring & assessment tool for Class-I, II & III
  • Course curriculum based session plan for Class-I, II, III) (Adhibeshana Jojana)
  1. Collection and compilation of Tribal music instruments and games (Ama Badya Jantra & Ama Khela)
  2. A book on livelihood and occupation (Pesa)
  3. Multilingual wordbook in 10 languages including Odia & English for Class I to III
  • A book on TLM preparation and its utilization
  1. Project Team
  2. Teachers and Teachers’ Training
  3. Role of Stakeholders
  • Peer educators
  • Community members
  • Parents
  • Language experts
  1. Management of the Project
  2. Assessment of the Project’s Impact: learning outcomes, dropout retention, teacher knowledge and application in classroom
  3. Findings
  4. Conclusion
  5. Recommendations

3. Reporting:

A high-quality, analytical evaluation report will include

  • Assessment of the Language Lab, relevance of resource materials for the children and teachers — developed in the most efficient (economical) manner.
  • Assessment of the capacity building programmes carried out and the outcomes
  • Documentation of the implementation of the MTBMLE approach
  • Analysis of output, outcome and impact of the MTBMLE approach
  • Impact of MTBMLE approaches on five stakeholders groups: (A) MTBMLE students (B) Teachers (C) School Management, (D) Parents and (E) Community Members
  • Compilation of good practices, innovative interventions, classroom monitoring mechanism and shortcomings
  • Recommendations

4. Timeline of Engagement and Deliverables

The evaluation will be carried out from September-December 2018 through the following process

 

Strategy Review Approach

  1. September 19th 2018: Presentation of evaluation questions and proposed approach along with a draft evaluation plan submitted to MTBMLE Advisory Council[1] for necessary input.
    1. Last week of September 2018:Familiarization with the project progress reports and other relevant project-related materials;
      1. Designing the detailed evaluation methodology, including the methods for data collection, questionnaire and analysis.
    2. Last week of September 2018: Setting up a detailed evaluation schedule with dates in coordination with the MTBMLE Project Manager/M&E Officer.
    3. Last week of September 2018: Communication with the Project Manager for clarification, if any.
  2. October 10: Final evaluation plan incorporating stakeholder’s comments submitted to MTBMLE Advisory Council and BvLF

 

 Desk Review of MTBMLE Resource Material

  1. October 25: Brief analysis report on resource materials delivered to MTBMLE Advisory Council

 Assessment of Classroom transactions 

  1. November 10, 2018: Brief draft report on the above assessment submitted to MTBMLE Advisory Council for strategic discussion
  2. November 25, 2018: Consultant submits final report
  3. Final Submission December 10, 2018: Draft strategy brief submitted to MTBMLE Advisory Council seeking constructive comments
  4. December 20, 2018: Consultant presents draft brief and engages in strategic discussion with the MTBMLE Advisory Council, followed by finalization of the report.
  5. December 30, 2018: Consultant submits final written report and a PPT presentation, summarizing the report, to the MTBMLE Advisory Council and BvLF.

5. Evaluation Framework

The evaluation team will study the logic model components of the project in order to design the evaluation framework.

Input Output Outcome Impact
·  Development of pedagogy and capacity building in terms of child psychology, tribal languages and culture. ·  Curriculum and lesson plan developed under the project

·  Developed 20 Resource persons under MTB-MLE project.

·  Resource Materials: Transition curriculum, pictorial dictionaries for Classes I, II, III, TLM book, teachers’ guides, creative short story books (Kahani Pedi), Rhymes & riddles (Kahila Dekhi), song book (Ama katha Ama Geeta), Games (Ama Khela), alphabet learning barnabodha in 7 tribal language, alphabet learning cartoon movies in 7 tribal languages,word book (Ama Paribesha), session plans for the class-I,II,III  etc.

·  Student’s assessment tools, session plan monitoring tools etc.

·   Project staffs, teachers, and coordinators who improved and developed their capacities through the training processes

·   Students in KISS showed their self-confidence, enjoyed learning, and reached better learning achievement.

·   Usability, relevance and completeness of the assessment tool.

·   Production of Teaching and Learning materials in multilingual education.

·   Teaching manual has been developed for a complete multilingual education.

·  Besides the targeted audience, the message of MTB-MLE reached among the higher-class teachers and students.

·  Message of MTB-MLE reached beyond State.

·  Discussion is going on among the Govt. officials under Project MTB-MLE.

·  Willingness of Govt. State Resource Persons under MLE to participate, give inputs and take lesson towards their classes.

·  Created goodwill and good impression on MTB-MLE among the concerned Govt. Department officials on MTB-MLE projects. For Example: ST & SC Dev. Dept., OPEPA, ATLC etc..

Review, Reporting, Monitoring

Documentation

 

·  Monthly check-in meeting regularized

·  Monitoring of classroom observation regularized on monthly basis.

·  Periodic reporting on project activities are prepared and shared.

·  Website on MTB-MLE project developed.

·  Language mapping records maintained.

·  Baseline, midline and end line assessment reports maintained.

·  Up gradation of classrooms on theme based (tribal culture, language) child centric.

·  Photographic and video-clip documentation.

·  Parenting Practices among the 13 PvTGs of Odisha.

·  Observation of International Mother Language day and other children festivals.

·  Project Activities on track.

·  Feedback and comments improvised teaching skills.

·  Information disseminated for wide spread.

·  Dissemination of information for public domain.

·  Data based is maintained.

·  8 nos of theme based upgraded classroom are developed and being utilized.

·  A book on 13 PvTGs of Odisha developed .

·  Once in a year, the stakeholders of various languages get platform to reflect upon.

·  The model of MTB-MLE in KISS attracts beyond state.

·  Increase no. of visitors to language lab.

·  Teachers from the Govt. departments expressed the importance of MTB-MLE module to be implemented across Odisha.

·   MTB-MLE approach has gone to the public domain,.

·  Curiosity is expressed on the upgradation of classrooms by increased no. of visitors from national and international level.

·  Govt. of Andhra Pradesh wish to adopt MTB-MLE module of KISS.

·  Sense of ownership realized/ inculcated among the various stakeholders on MTB-MLE KISS.

·  Human Resource

·  Project Management

·  Numbers of trained human resources are appointed.

·  Mobilization of consultant and language experts.

·   Trained staff implemented the Project with creativity and innovation.

·   Equipped with knowledge about local history and culture.

·   Capable of coordinating with government and school personnel, parents, and communities.

·   Capable of communicating abstract and technical aspects of MTB-MLE.

·   Instructional, content-based materials developed collectively.

·   A sense of commitment, sincerity and punctuality emerged among the staff members.

 

·  Project Manager recognized and invited for giving talks on the innovation modules developed under MTB-MLE at various state and national level research and educational institutes.

·  13 numbers of national and international level graduate and post-graduate interns have done their internship under the Project Manager.

·   Special invitation by the ST & SC Dev. Deptt., Govt. of Odisha on the occasion of Annual State Level Adivasi Mela to showcase MTB-MLE Approach.

·  Facilitated knowledge among the national and international visitors.

·  Representation in SDG (Sustainable Development Goal) organized by KISS & NITI Aaayog, Govt. of India.

 

 

Sources of data: The intended evaluation will be carried out based on the data sources available both from primary and secondary source like project documents, project holder, project personnel, school administrator, stakeholders like teachers, students, parents etc.

6. Eligibility

The vendor(professional institutions/experts group/individual consultant) should meet the following eligibility criteria:

  • An understanding of the concept, approach and policy framework of MTBMLE
  • Experience of appropriate child centered education system
  • Expertise in evaluation, with sufficient knowledge in tribal culture & language and communication skill in both Odia and English
  • A history of successfully deploying primary education systems
  • Experience of course curriculum development for primary school set up
  • Technical expertise in proofreading, editing and authoring early childhood books and teaching – learning resources, ECCE & MLE interventions study materials
  • Experience in providing technical support to project management
  • Technical expertise in classroom transaction observation Technical expertise in scalable programmes
  • Availability of key individuals with applicable skills such as:
    • Experience of working according to client’s requirements

7. Consultant/Vendor Screening Process

Initial Screening: MTBMLE will review the proof of Legal Name, Minimum Qualification sheet and expertise in this field. Submittals found responsive and responsible based on this initial screening shall proceed to next step, i.e. Evaluating the Proposal Response, Sample Questionnaire, Cost Proposal, Prior Work Samples, and List of Professional References.

 

Proposal Evaluation:  The MTBMLE Advisory Council with a composition of one of each delegate from BvLF, KISS Management & Project will evaluate proposals using the below criteria. Responses will be evaluated, scored, and ranked.

 

Evaluation Criteria: 

Areas of evaluation Basic Evaluation Criteria Total Score
Team Composition and Competencies ·    The team meets or exceeds minimum qualifications

·    The team meets or exceeds desired qualifications

 

20

 

Project Work Plan ·    Work plan describes a thoughtful approach that is aligned with the evaluation questions in the Scope of Work section

·    Approach names team members responsible for each task/subtask.

 

35

Proposed Communications and Timeline ·    Proposed communications and timeline align with the output schedule detailed as mentioned under the head of deliverables. 10
Cost Proposal ·    Costs appear to be reasonable and within the Scope of Work. 10
Prior Work Samples ·    Work samples are high quality and relevant to the Scope of Work. 20
List of Professional References ·    Proposal provides a list of at least two professional references for each team member and sub-consultant.  

5 (meets)

 

0 (does not meet)

 

Interviews: In case of interview, the MTBMLE Advisory Council shall determine rankings of consultants using the combined results of interviews and proposal submittals.

Selection:  The MTBMLE shall award the evaluation project to the highest ranked Proposer(s) based on their interview (if applicable) and written proposal.

8. Proposal Submission

The project reserves the right in its sole discretion to reject any consultant response that fails to comply with the instructions.

 

Confidentiality clause: All correspondences relating to the evaluation process, reports, raw data sheets, presentation, videos and photographs (including drafts) are the sole property of KISS. The proposer has to agree to maintain confidentiality, unless and until decided upon by KISS management and BvLF.

 

Procedure

a.      Proposals to be received no later than the date and time mentioned in Page 4& 5.
The Proposer has full responsibility to ensure the proposals are received with requisite conditionals within deadline.
  1. The project has the right to reject proposal delivered after the deadline without mentioning any reason.
  2. All pages are to be numbered sequentially, and closely followed the requested formats.
  3. The report has page limits specified (see page no-3) in the submittal instructions section. Any pages that exceed the page limit will be excised from the document for evaluation purposes.

Copy Submittal:

  1. The Project will not accept Fax or DVD/Flash Drives copies as an alternative to the paper or electronic e-mail copy submittals. If a CD or fax version is delivered to the project, the paper or electronic e-mail copy will be the only official version accepted by the project. Delivery is to the address: MTB-MLE, Project Building, KISS, KIIT Campus-10, and Bhubaneswar, 751024.
  2. Please submit the conditional documents to s.mohanty@kiss.ac.in within deadline
    • Title “Proposal for Evaluation” to be mentioned in the subject line of the e-mail.
    • Any risks associated with electronic submittal are borned by the Proposer. Each proposal will receive an acknowledgement email.
  3. Hard-copy responses should be in a sealed box or envelope marked and addressed. If submittals are not marked, the Proposer risks the response being misplaced and not properly delivered.
  4. The submittal may be hand-delivered or otherwise received by the Admin Assistant, MTB-MLE at the address provided.
  5. All the authorities of selection of vendor/agency are under the control of MTB-MLE Advisory Council body.

 

Procurement Contact: Dr. Sushree Sangita Mohanty, Project Manager

Email : sushree.s.mohanty@kiss.ac.in

Contact No: 0674-2725386

Address: MTB-MLE, Project Building, KISS, KIIT Campus-10, and Bhubaneswar, 751024.

[1]The MTB-MLE Advisory Council is a composition of 4 members consisting of one delegate from BvLF, two delegates from KISS Management & one from Project.