[Artículo y vídeo en inglés]
Juanita Smit, Senior Specialist in the Supervisory Framework Department of the Financial Section Conduct Authority (FSCA) in South Africa, was invited to share her experience at Cerise+SPTF's 2024 Annual Meeting. The discussions with Juanita explored how to track and utilize outcomes data to strengthen regulations for responsible and inclusive finance.
We've asked 5 questions on the value of outcomes data for regulators. Juanita has shared valuable insights on the role of regulators.
Below you can watch the video and read the summary transcript of the discussion.
Question 1: Why, as a regulator, do you want to collect outcome data on customers, and what's the entry point for you on this journey?
For the FSCA, the first point is to meet our mandate. Our mandate encompasses different strategic objectives, one of which is that of ensuring fair outcomes for customers. Outcome data helps us measure and test whether fair outcomes are being achieved for customers. It also contributes to financial stability in the industry.
You can talk the talk, but data helps us see if companies are truly walking the talk. Everyone claims to be customer-centric, but data does not lie. The data helps us determine if outcomes are fair and, if not, why not. This allows us to engage with entities, identify gaps in understanding, and ensure fair treatment from the outset.
Outcome data also helps us detect harmful products, identify potential customer education gaps, and determine whether interventions are needed at an industry level or for specific target markets.
In our discussions with entities—including FSPs, banks and pension funds—the data serves as a concrete foundation. Instead of vague discussions, we can show specific data insights and explain how we reached certain conclusions. This has proven beneficial for entities as well.
For example, we worked with one entity that believed complaints about service were due to third-party providers. After analysing various data sources, including social media, we found that the complaints were actually about the entity’s internal service department. The company was losing customers without understanding why. This insight allowed them to address the real issue effectively.
So, collecting outcome data is definitely about protecting customers and ensuring fair outcomes. That’s the short answer. We’ll continue the discussion on the next steps, but that’s an important point to highlight.
Question 2: What method do you use to collect information, and where do you stand in the process? Who collects the information, and how do you obtain customer data?
We receive information from various returns, which are submitted to us by the regulated entities. In the past some of these returns were similar to compliance reports, which required entities to confirm their adherence to regulations. However, we realised this approach was too rule-based and functioned more like a tick-box exercise.
We changed our approach when we started thinking about collecting market conduct data. The returns had to give more insight into customer experiences and the outcomes being achieved in the industry. We therefore started developing a specific market conduct return, with only quantitative questions, and subsequently rolled it out to the insurance sector as a first phase. The data was submitted on a quarterly basis.
Currently, we are also receiving data on customer experiences, their perceptions of financial products and whether fair outcomes are being achieved from external customer sources. We are in the process of further developing the market conduct return. The new market conduct return will be cross-sectoral and supplement the external data which we already receive.
The approach remains the same: to communicate clearly with industry on what we expect and why we need the information. Consultation and collaboration are imperative to the success of such a project. The new return will be implemented by using a phased in approach.
Question 3: What are the main challenges you face in this process?
The first challenge is securing industry buy-in. While entities already have the necessary data, they may not have it in the required format or level of detail. Larger entities typically have the data but need to adapt their systems, while smaller FSPs may lack the necessary technology or awareness of the data’s benefits.
We must clearly communicate why we need the data, how we will use it, and what entities can gain from it. This process can be costly for both regulators and industry players. To address this, we are investing in new systems and collaborating with other regulators to avoid redundant information requests.
The second challenge is data quality. Even after seven years of implementation in the insurance sector, we still face issues with data completeness and accuracy. Initially, we allowed a three-year grace period where entities could submit their best efforts to help them adapt. However, improving data quality remains a long-term effort.
Another challenge is capacity—both on the industry side and within the regulator. On our side, we need skilled analysts who can interpret data effectively and facilitate meaningful discussions with entities. Building trust is also crucial, as entities need to believe in the fairness and purpose of the process.
Overall, it’s a long journey requiring continuous improvement in risk management and data utilisation.
Question 4: What advice would you give to regulators and financial service providers who are starting this journey?
I hope we are inspiring others, because there is a lot of value in this process for everyone.
One key lesson from our insurance industry experience is the importance of clear, transparent, and collaborative communication with the industry, from the start.
With the Omni-CBR, before requesting feedback, we conducted webinars for different sectors, explaining each question and its purpose. This built trust and ensured that entities understood our goals. Many entities then proactively engaged with us to clarify questions before submitting formal comments.
Despite this, we still received pushback, which is understandable and expected. This is a costly initiative, and regulators must be patient, allowing for multiple rounds of consultation and phased-in implementation. However, clear deadlines are necessary to maintain progress.
Industry players should avoid outright resistance. Instead of rejecting changes due to cost or complexity, they should actively participate in shaping the process. Regulators and industry are partners—this effort benefits both sides. Industry is always ahead of regulators in innovation, so collaborating helps regulators keep pace.
A key benefit of this process is creating a level playing field and improving consumer trust in financial services. Consumers need to see that real work is being done to ensure fair outcomes.
For regulators:
- Communicate openly and transparently from the start.
- Be open to industry feedback, sometimes industry can suggest better ways of doing things or structuring data.
For industry:
- Engage with regulators proactively rather than resisting change.
- Recognise that regulatory oversight benefits the entire industry and contributes to consumer confidence.
This must be a collaborative effort.
Question 5: If you had to choose one key indicator or type of data that you find most useful, what would it be?
That’s a tough question because I like many indicators!
One important aspect is that complaints data alone is not enough. While we collect complaints and customer survey data, we also focus on indicators that reveal corporate culture.
For example, beyond just tracking complaints, we ask:
- How long does it take to resolve a complaint?
- What is the customer experience like for payments, refunds, or fund transfers?
- How quickly does an entity execute customer instructions?
These turnaround time metrics allow for benchmarking across the industry. Entities often ask, “If this isn’t acceptable, what is the industry standard?” With this data, we can provide accurate benchmarking insights.
This is crucial for industry self-assessment and improving customer experience. I could talk about this all day, but I’ll stay with turnaround time indicators as my top choice!
Background:
In 2022, the FSCA started developing a consumer advisory panel to ensure that its work formally takes into account the views and experiences of consumers. The panel was established in 2023 and alerts the FSCA to emerging risks and trends facing financial customers. CGAP has supported this effort by facilitating the use of two tools that have been helpful in getting started: mentoring relationships and a stakeholder analysis.
Mentoring relationships: CGAP facilitated a partnership between the FSCA and the UK Financial Conduct Authority (FCA) and their Financial Services Consumer Panel (FSCP). The FCA and FSCP bring a wealth of knowledge and experience to FSCA’s deliberations. It is important to note that this pairing was not for the purpose of transplanting the UK model to South Africa, but rather for FSCP/FCA to be a sounding board to respond to questions and brainstorm options with FSCA counterparts.
Stakeholder analysis: CGAP supported a stakeholder analysis conducted by Cenfri to help the FSCA better understand the consumer landscape and relative influence, interest, and capacity of different consumer groups. While formal stakeholder analysis may not be needed in every case (especially for smaller EMDEs), it may be worthwhile in jurisdictions where the landscape is complex or unfamiliar.
More resources:
- FSCA Subscription Page
- CGAP's reading deck summarising lessons from a pilot exercise that involved the Financial Sector Conduct Authority (FSCA) and five FSPs in South Africa focused on measuring intermediate customer outcomes from a supervisory perspective.
- CGAP 2022 paper on Consumer Advisory Panels: a tool to elevate the collective consumer voice in financial sector regulation and supervision.
Únase a los miles de usuarios en SPI Online
Herramientas de evaluación poderosas para cambiar las intenciones en impacto.