evaluation
Evidence type: Evaluation i
Information about the programme design and rationale
Evidence about Financial Capability outcomes for programme participants
Evidence that the Financial Capability outcomes were caused by the programme
Evidence about programme implementation, feasibility, and piloting
Evidence about relative costs and benefits of the programme
There is a growing consensus, amongst policy makers and NGOs, that financial education needs to be expanded, following the global economic crisis. However, evidence supporting the effectiveness of financial education is limited, in particular causal analysis is scarce and offers mixed results.
The World Bank developed the following field experiment to fill this gap, by capturing causal evidence of the effectiveness of financial education, and exploring the extent to which this is enhanced when combined with other interventions:
Each training session lasted 2-3 hours over five consecutive weeks. Participants were shown a video on the following topics: budgeting, savings, loans, insurance. After the video, the class (around 20) took part in a discussion led by a trained instructor. The videos used popular local actors and scripts were tested with local audiences.
The programme achieved an attendance rate of close to 100%. The authors do not comment on why this might be the case but they do note that all participants were already engaged with a local NGO, either in receipt of micro-finance or accessing another urban development programme.
The study was conducted in Ahmedabad, an urban city in India, over four waves. The evaluators adopted a randomized evaluation approach, with a large sample of over 1300 participants. Two thirds of the sample were allocated to a Financial Education treatment group and one third was allocated to a control group. This group received a health education programme of the same intensity, so that both groups experienced similar levels of disruption to control for Hawthorne effects (whereby participants who know they are being studied are prone to modifying their behaviour).
There were also three additional treatment interventions delivered on a randomized basis, allocated in the following ways:
Within the treatment groups, there were groups who had received: financial education only; financial education with a monetary incentive; financial education with goal setting, and a very high intensity treatment which included all three components.
Respondents received Rs. 50 (US$1) to attend each session and transportation was free.
There were three data collection points: a baseline survey, a post-intervention knowledge survey, and a final survey which captured behavioural outcomes.
Budgeting: Financial Education had significant effects on understanding the benefits of budgeting (22% higher than control) and attempting to make a budget (28% higher than control), however the effect on ongoing budgeting was small (only 3% higher than control). The effect of financial education classes combined with goal setting was limited to raising awareness of budgeting and again, did not cause regular behaviour change. However, adding counselling to the former treatments caused a significant effect on sustained behaviour change. Those who received financial education with personal counselling were 38% more likely than the control group to have attempted a budget and 4% more likely to make a regular budget. This effect was even greater amongst those also in receipt of goal setting (43% and 5%).
Methodological considerations
Generalisability/ transferability:
Fenella Carpena, University of California at Berkeley , Shawn Cole, Harvard Business School, Bilal Zia