Online Safety Community

Education Technology’s Machine Learning Problem

From Formula 1 to Yelp, industries across the board are seeking ways to apply machine learning to their work. Even academics and Goldman Sachs analysts tried using it to predict World Cup winners. (Those predictions proved very, very wrong.)

But how is machine learning playing out in education—and how does it impact not just students, educators and parents, but also the businesses building technology tools to support teaching and learning?

At the SF Edtech Meetup, hosted by EdSurge on July 10, four panelists gathered to discuss the challenges around deploying machine learning in the classroom and the boardroom. The speakers were Carlos Escapa (Senior Principal, AI/ML Business Development, Amazon Web Services), Vivienne Ming (Founder and CEO, Socos Labs), Matthew Ramirez (Director of Product Management, AI Writing Tools, Chegg) and Andrew Sutherland (CTO and co-founder, Quizlet).

The Data Problem

What makes machine learning work is data—but that data can be biased in problematic ways that can lead to misleading and disturbing outcomes. (Ming referenced the time when Google’s image recognition algorithms classified black people as gorillas.)

“When you’re doing this in advertising, who cares if you get some of it wrong,” Ming said. “When you’re doing it in diagnostics or in education or in hiring, you potentially just ruined someone’s life. You have a real moral obligation to understand why your system is making the recommendations it’s making.”

Education and human development is complex, Ming noted, and there’s still not a mass of training data that connects what activities four-year-olds do with their parents in the evenings to what their life outcomes will be. In complex data sets, particularly ones with lots of human data, she warned, the number of spurious correlations that don’t actually mean anything are often more common than evidence of reliable causal relationships.

If there’s something wrong with the data you’re using to support a decision, added Escapa, then there will be something wrong with the decision. Data must be representative of the population it’s trying to serve, and there must be sufficient data from that population. “It’s very easy to make a mistake creating a model where you’re trying to generalize a solution to a problem, and you actually have insufficient data from some of the demographics that you’re trying to address,” he said.

Great Data, Great Responsibility (and Costs)

So what can education companies do to reduce biases in their tools?

Ramirez advised that a company wanting to build out its machine learning system should figure out a “ground source of truth” that guides how a company is building its tools.

There’s human effort involved as well. Ming recommended that companies hire domain experts who can build the machine learning system. And what Ramirez has found helpful for his writing tool are human annotators who can look at the data and identify whether or not a student should receive a certain suggestion or piece of feedback.

Machine-learning technology can help humans perform these types of tasks. “I think AI assistive platforms are super fascinating and really interesting, because there are a lot of human experts that can do this kind of work, that are eager to do this kind of work, and are extremely well qualified to do this kind of work,” Ramirez said.

But getting this support isn’t cheap. For those that have raised venture capital, Ramirez says it’s reasonable to expect at least half of that money to go towards AI research and development—and hiring machine-learning engineers. Companies need to allocate a bigger budget to hire these experts than for general web developers, he noted.

These costs are “something that I think a lot of people going into this industry don’t foresee, and which venture capitalists are now just learning how to forecast.” For that reason, he welcomes the hype around AI among venture capital circles.

What Should Teachers Ask?

Investors are not the only ones barraged with pitches from edtech companies promising that their AI and machine learning tools with transform education. Increasingly, so too are educators and administrators who make decisions around what technologies to use and purchase.

So what how can they do to make smart choices—and not fall for gimmicks?

Escapa thinks educators should ask AI companies what data they use to generate their models, how they curate that data, how often they update those models and how they know their data doesn’t have bias. Also, educators should tell companies to convince them that their data is representative of the population they serve.

Sutherland said that educators should also be able to try artificial intelligence technology before making a purchase.

“It’s one thing to have Powerpoint demos or a fixed demo where you say, ‘Oh, it produced this decision or this outcome.’ But then there’s another way—you actually have a teacher try the tool for five minutes,” Sutherland said. “They know all the mistakes a student might make. They can try them on the tool, and if it doesn’t work, then it doesn’t work.”

Read more at http://bit.ly/2JgakOQ

Views: 14

Comment

You need to be a member of Online Safety Community to add comments!

Join Online Safety Community

Take our poll!

Take our poll!

Latest Activity

Mark Nilson posted an event
Thumbnail

Stay Interviews: How to Increase Employee Retention and Drive Engagement with High Impact Stay Interviews. at Training Doyens 26468 E Walker Dr

August 29, 2018 from 1pm to 2pm
OVERVIEWThe best way to find out what your employees want and how to retain them is to ask them. Ask questions to gauge how you’re meeting your employees’ expectations. Not just “How’s it going?”, but specific questions to get specific answers.The stay interview is a one-on-one interview between a manager and a valued employee. Its aim, quite simply, is to learn what makes employees want to keep working for you. Likewise, it's…See More
1 hour ago
Training Doyens posted events
Friday
Adam Fleaming posted a blog post

Having a [baby] is exorbitant and befuddling, notwithstanding for a wellbeing approach master

It is hard to believe that it has been just over since five months since our second son, Lukas, was born on Feb. 3. His mother, Hollyanne, is doing well, which is something to be thankful for, given the excessive maternal mortality rates in the U.S. Lukas is also healthy and growing, albeit sleeping little at night. What is unbelievable…See More
Thursday
Tytti posted a blog post

Safety Sign Colors and International Standards

Colors make a difference to our environment. They help us analyze the surroundings and distinguish between objects. We recognize plants as green and the sky as blue, whereas a frog, for example, can be either green or blue. Deviant colors, in this case blue, warns us about poisonousness. If we detect unusual colors in our food, for example, we associate them with rottenness, which then activates a warning in our mind “Don’t eat!” Colors cause diverse feelings and opinions, and even distinct…See More
Thursday

Forum

5 TECHNOLOGY-BASED LONE WORKER SAFETY SOLUTIONS

ABOUT 75% OF EMPLOYEES IN NORTH AMERICA ARE MOBILE WORKERS. ADVANCES IN COMMUNICATIONS TECHNOLOGY MEANS THESE WORKERS CAN WORK ANYWHERE AT ANY TIME. THESE NEW TECHNOLOGIES ALSO MEAN THESE MOBILE…Continue

Tags: Solutions, People, IoT, Monitoring, Remote

Started by Jen McDade May 31.

Road Safety Solutions 14 Replies

The Road Safety Signs ,Barriers,Humps,Hazard Markers and Visual Warnings are some of the important marks to be observed. Signs such as "keep left",stop, "give way" should not be casually treated.…Continue

Tags: safety, gear, wear, Equipment, &

Started by Enna Henry. Last reply by Jen McDade May 31.

Remote Monitoring

Get "Safe Assets and Sound Productivity" Through Remote Monitoring.Visit:…Continue

Tags: Solutions, People, IoT, Monitoring, Remote

Started by Jen McDade May 23.

Python Condition Objects Tutorial in 2018 1 Reply

If you have knowledge of other programming languages, then you would know the importance of conditional statements. Conditional statements are required for taking decisions. Whenever we operate the…Continue

Tags: course, certification, training, languages, programming

Started by Elena Lauren. Last reply by Jim Chesters May 15.

Power BI Visualization Types

Visualizations in Power BI displays the visual insights from a data. In power bi service a visual can be pinned from reports to create dashboards. Visuals are used in reports.List of visualizations…Continue

Tags: COURSE, TRAINING, BI, POWER

Started by Azharuddin May 15.

Badge

Loading…

© 2018   Created by Safety Community.   Powered by

Badges  |  Report an Issue  |  Terms of Service