Why Compliance Teams Should Embrace Expert-in-the-Loop
July 8, 2021
Getting the most out of data used to mean relying on getting the data. Now, with Expert-in-the-Loop, human experts help you get the best data for your business.
Artificial intelligence continues to expand as a powerful presence in business, and in the compliance function, in particular.
That’s for good reason.
A recent IDC study shows that not using artificial intelligence for data gathering purposes results in a 10% loss in productivity for firms in the compliance and legal industry.
The same study shows that companies who are using AI today for data gathering purposes aren’t getting the most from their investment, however. That, IDC says, is primarily due to several highly solvable problems.
This from IDC:
Around 28% of the AI/ML initiatives have failed. Lack of staff with necessary expertise, lack of production-ready data, and lack of integrated development environment are reported as primary reasons for failure.
Fairness, explainability, robustness, data lineage, and transparency, including disclosures, are critical requirements that need to be addressed now.
Large enterprises still struggle to apply deep learning and other machine learning technologies successfully. Businesses will need to embrace Machine Learning Operations (MLOps) – the compound of machine learning, development, and operations – to realize AI/ML at scale.
Merging Human Expertise Into the Machine Learning Equation
Enter Expert-in-the-Loop (EITL) machine learning technology.
EITL is derived from Human in the Loop (HITL) machine learning applications, which adds human input into the data gathering process. Statistics show that AI algorithms are just 80% accurate. Add an “expert” human element to the mix, and that number soars upwards 100% to actual intelligence.
In a mainstream machine learning data gathering scenario, the algorithm produces the data, based on a prior initial assessment of what exact data is needed. Once that data is initially produced, human experts can assess the quality of the data, add their own assessments, and the algorithm can use those comments to improve the data and help maximize the data gathering process.
In a commentary in Forbes , Kayvan Alikhani, CEO and co-founder of Compliance.ai, describes EITL in more specific terms.
The Expert In The Loop model comes with the facility to measure an individual’s aptitude and even document his/her errors for future reference. While HITL uses inputs from many individuals without considering their relevance in the decision-making process, EITL recruits experts specializing in particular domains for assistance with associated supervisory tasks. HITL uses the ‘Law of Averages’ i.e. if many people’s inputs are used, the average result is correct. It is the way to go if one is looking for quantity over quality. EITL, on the other hand, makes for easier audits, intelligent algorithms, and more confident AI assessments.
EITL in the Regulatory & Compliance Sector
EITL, which Alikhani calls a “next-gen” AI model is already making major inroads into the financial services sector, particularly so in compliance, regulation and data security. There, machine learning analysts work hand-in-hand with compliance professionals to close information gaps, eliminate mistakes, and readjust data algorithm-driven classifications.
That not only helps gather superior data that can save companies potentially millions of dollars in compliance costs, but also significantly reduces regulatory risks as companies move forward in more aggressive and risk-laden financial markets.
Companies who leverage EITL machine learning technology don’t have to rely on hiring internal experts to assess and adjust data algorithms for them. Instead, they can rely on machine learning developers to handle that task for them.
Consider, for example, an investment firm concerned about tagging specific regulations to specific asset managers for more accurate compliance.
Instead of absorbing the costs of bringing in experts, Compliance.ai provides its own network of contributors, a group of regulatory and compliance experts, to review business documents and add the proper tags. Better yet, the Compliance.ai regulatory change management tool also learns and internalizes any tag changes and will automatically tag similar investment firm content needed down the road.
A Step Up for Machine Learning
Expert-in-the-Loop represents a data algorithm upgrade for compliance teams looking to collect new information and, after assessing the data with help from experts, help machine learning models improve over time using new expert-driven data.
That not only helps companies eliminate error-prone and time-consuming compliance tasks, it gives companies access to regulatory industry experts who can help compliance teams establish oversight over machine-learning data gathering models.
That scenario combines the best elements of technology and humane expertise for regulatory-minded companies operating in the AI realm.
Asif Alam is the Chief Executive Officer at Compliance.ai. A leader in shaping disruptive technology, his experience includes building products using AI and natural language processing for GRC, payments, lending, risk, trading, and new solutions, from Fortune 500 companies to startups.
In his most recent role, he served as the Chief Strategy Officer of ThoughtTrace, unlocking new revenue streams and markets, and reignite portfolio growth. ThoughTrace was then acquired by Thomson Reuters in 2021.
He brings more than 20 years of management and business experience; increasing profitability, unlocking new revenue streams and markets, and reignite portfolio growth for companies like Thomson Reuters, Crux Informatics, and Finastra. Asif is a forward-thinking expert driving engagement via client forums, public presentations, and white papers.
Cesar Lee is a Principal at WRV, a venture capital fund focused on early-stage investments in hardware, semiconductor, and other technology-related companies. Previously, he was an investment professional at Riverwood Capital, a technology-focused, late-stage venture capital, and private equity fund. He began his career at RBC Capital Markets, where he was part of the Mergers & Acquisitions group for two years and the Equity-linked & Derivatives group for one year. While at RBC, Cesar spent a majority of his time working on M&A advisory transactions for technology companies.
Cesar’s investment experience includes buyouts, later stage, early stage and seed rounds. Cesar has completed transaction in the U.S., Latin America, and Asia, and in technology sectors including data centers, software, semiconductors, consumer electronics, robotics, big data, and internet.
Maria Devassy is a RegTech, Content, and Technology leader with over 20 years of experience helping companies bridge the gap between technology, product, and business. Maria has held leadership positions with MetricStream, KPMG, Oracle Corporation, and other technology companies. She has launched several successful RegTech products, business partnerships, and advised Fortune 100 clients on risk management, audit, advisory, and compliance business across Industries.
Hugh Cadden is a recognized expert in derivative financial and trading markets including futures, options, and swaps. Hugh is currently a senior consultant and expert with OnPoint Analytics, Inc. an economic, finance and statistical consultancy specializing in expert testimony for complex litigation. He has been specializing in the organization, operation, and regulation of financial and trading markets for over 40 years. Hugh’s experience includes both the public and private sectors and he has held senior level positions with the U.S. Commodity Futures Trading Commission including serving as Director of the Division of Trading and Markets and Deputy Director of Enforcement. He has been qualified as an expert on financial and trading market matters before the Commodity Futures Trading Commission, the Securities and Exchange Commission, the U.S. Tax Court, Financial Industry Regulatory Authority, National Futures Association, American Arbitration Association and federal courts.
Drake Ross is a former bank regulator who specialized in compliance with consumer protection regulations while at the OCC, FDIC, and OTS. While at these agencies, he provided extensive training and guidance and developed materials to ensure full comprehension and proper application of rules, laws, policies, and guidance, and served as a Subject Matter Expert in numerous areas. Because of his expertise, he often presented at agency and industry events. He also played a significant role in successful windup of the 2008 IndyMac Bank failure, where because of his extensive knowledge of the FDIC deposit insurance regulations, he was called upon to administer highly-complex insurance determinations.
Carliss Chatman is an Assistant Professor of Law teaching Contracts, Agency and Unincorporated Entities, Corporations, and Transactional Skills. Her work is influenced by over two decades of service on non-profit boards and involvement with community organizations. Through leadership positions, she has developed expertise in corporate governance and non-profit regulation. She has also been instrumental in strategic planning and fundraising efforts. Prior to law teaching, Professor Chatman was a commercial litigation attorney in Houston, Texas. In practice, she focused on trial law, appeals and arbitration in pharmaceutical, health care, mass torts, product liability, as well as oil, gas, and mineral law. In addition to negotiating settlements and obtaining successful verdicts, Professor Chatman has also analyzed and drafted position statements regarding the constitutionality of statutes and the impact of statutory revisions for presentation to the Texas Legislature.
Sign me up for all regulatory updates
Get access to EITL Forum recordings
Mariam is an Operating Principal at Cota Capital. Mariam has experience providing guidance on strategic and operational planning to Venture and Growth stage companies. Prior to Cota Capital, Mariam spent her career in management consulting as a Director at KPMG. She has experience leading global transformation programs and developing innovative service offerings for Fortune 500 companies in the Technology sector. Mariam has an MBA from UCLA’s Anderson school of management with an emphasis in Finance and Entrepreneurship. She has a Bachelors in Science in Finance and a Bachelors in Science in Economics from Santa Clara University.
Chris Callison-Burch is an Associate Professor in Computer and Information Science Department at the University of Pennsylvania. His research interests include natural language understanding and crowdsourcing. He has served the Association for Computational Linguistics as the General Chair for the ACL 2017 conference, as an action editor for the Transactions of the ACL, as an editorial board member for the Computational Linguistics journal, and an officer for NAACL (the North American chapter of the ACL) and for SIGDAT (the special interest group for linguistic data and corpus-based approaches to natural language processing)
Tom Ladt is an experienced executive and investor. Tom has lead and served on the boards of several public and private companies serving highly regulated industries such as technology, healthcare, real estate, and food processing. Tom has also served in key governmental roles and on numerous community boards.
Jeroen Plink is a global executive with a proven track record of developing and growing businesses, teams, and technologies with innovation and passion. Jeroen was CEO of Practical Law US during its acquisition by Thomson Reuters. He now serves on numerous boards and acts as a strategic consultants for start-ups.
Global Legal and Compliance executive with 15+ years of success in the SaaS technology and financial services industries. Partner to the CEO and executive team in corporate transactions, business development, product expansion, and regulatory navigation during periods of intense growth and organizational change. An advocate of effective risk management that starts with sound business practices and putting the customer first.
Richard Dupree has held multiple Risk, Compliance and Operations positions at regional, national, and global financial services firms including Wells Fargo, Silicon Valley Bank, Bank of the West and BNP Paribas. Rick currently advises FinTechs and RegTechs and sits on industry panels, contributes to industry whitepapers, thought leadership efforts, and speaks at industry seminars on Risk and Compliance challenges faced by banks and FinTechs.
Brian advises clients on legal and regulatory compliance in the financial, tech, and procurement sectors. His passion is helping businesses succeed in heavily regulated environments. As counsel and trusted advisor to businesses of all sizes, and as a former regulator, policymaker, and federal official, Brian acutely understands the unintended burdens that even well-intentioned government requirements can put on innovation and business growth, as well as how to create policies that strike the right balance.
Brian served as National Ombudsman in the Obama Administration, leading the federal Office of Regulatory Enforcement Fairness in assisting hundreds of startups, entrepreneurs, and small business owners in every industry and every state.
Dr. Marsha Ershaghi Hames is Managing Director of Strategy & Development at LRN, a leader in advising and educating organizations about ethics and regulatory compliance, as well as corporate culture, governance and leadership. With the focus of inspired behavior versus required behavior, LRN is a leading voice in the industry for companies to build ethical cultures instead of “check-the-box” compliance approaches. She’s advised Department of Justice corporate monitors on successful program transformation under CIAs (Corporate Integrity Agreements. With over 20 years of experience in leading multinational ethics and compliance strategies, Marsha has become a highly sought-after thought leader on leading Corporate Compliance and Ethics practices.
Carla Carriveau is currently the Senior Managing Counsel at Wealthfront, an automatic investment service firm in Redwood City, California. Carla was previously Senior Counsel, Division of Trading and Markets, at the United States Securities and Exchange Commission. As a former regulator with over 15 years of experience in helping small businesses navigate legal and regulatory needs in the financial services sector, Carla advises Compliance.ai on financial services regulation, the regulatory landscape and industry practices.