Web White Noise

Now, some computer science researchers say one solution may lie in the design of software itself – even programs regular people use every day.

Laura Beckwith, a new computer science Ph.D. from Oregon State University, and her adviser, Margaret Burnett, specialise in studying the way people use computers to solve everyday problems – like adding formulas to spreadsheets, animation to web sites and styles to word processing documents.

A couple of years ago, they stumbled upon an intriguing tidbit: Men, it seemed, were more likely than women to use advanced software features, specifically ones that help users find and fix errors. Programmers call this “debugging,” and it’s a crucial step in building programs that work.

Beckwith decided to investigate why women and men might interact so differently with the same software. She pored over 30 years’ worth of books and academic papers from psychologists, education researchers, economists, computer scientists and others about gender differences in problem solving and computer use.

One theory grabbed her attention: High confidence correlates with success. Both men’s and women’s confidence in their ability to do a challenging task affects their approach and the outcome. And most studies indicated that women – even ones who study computer science – have less confidence than men in their computer skills.

So Beckwith wondered, could that be one of the culprits? Are women less confident than men when it comes to software debugging? Are women less willing than men to try using these advanced features?

Beckwith tackled these and other questions in her dissertation, with guidance from Burnett and Susan Wiedenbeck of Drexel University.

She started by asking a group of women and men, in a questionnaire, whether they believed they could find and fix errors in spreadsheets filled with formulas.

Then, she sat them down in front of a computer with two spreadsheets. One tracked students’ grades, and another calculated employees’ paychecks.

Beckwith buried five errors in each one without telling the participants. She gave them a time limit and asked them to test all the formulas and fix any bugs.

The program included a debugging feature that helped the users spot miscalculations by the formulas underlying the spreadsheet and other errors. When they clicked on a number that seemed wrong – a grade point average that looked too low, given the student’s test scores, for example – cells in the spreadsheet grid that contained the possible source of the error changed colour. If the participants were sure a formula or value was correct, they could check it off.

In this experiment, the key to success was using the debugging feature. Both men and women who used it were better at finding and fixing the bugs.

The level of confidence expressed by the participants in the questionnaire about debugging, however, played a much different role for the genders.

For men, it didn’t really matter whether they believed they could complete the task. Some men with low confidence used the debugging tools, and some with high confidence didn’t.

But for the women, only those who believed they could do the task successfully used the automated debugging tools. The women with lower confidence in the task relied instead on what they knew – editing formulas one by one – and ended up introducing more bugs than when they started.

Beckwith was faced with a conundrum. From questionnaires handed out after the experiment, she knew women understood how the debugging tools were supposed to work, so it seemed their confidence level was lower than it deserved to be. She also knew that one way to boost confidence is through successful experiences. But it was this low confidence that was keeping women from using the debugging tool and having a successful experience.

As a computer scientist, Beckwith wasn’t interested in changing women’s confidence levels. She was interested in whether changing the software could help women over this hurdle.

So she explored whether a gentler presentation of the debugging tool, one that seemed to require less confidence, would appeal to women.

In the first study, the debugging tool let users mark values “right” or “wrong.” To mark something as wrong, participants had to right-click with the mouse.

In later studies, Beckwith added two more choices: “seems right maybe” and “seems wrong maybe.” The “maybe” buttons worked just like the more certain-seeming ones, but used softer colours to indicate possible errors. She also changed the program so that no one needed to right-click the mouse, something less-experienced computer users are reluctant to do.

Beckwith tested the new feature during several other experiments. When she tallied up the numbers, she found that in some experiments, women used some form of the debugging feature almost as often as men did. In others, they used the debugging tools even more than men did.

Although these experiments homed in on a tiny aspect of a computer user’s life – debugging spreadsheets – the implications could be quite large.

Burnett, the Oregon State professor, estimates that 55 US million computer users of both genders are essentially writing programs even if they don’t know it – such as when they set up filters on their email.

While software used by the country’s 3 million professional programmers include ample debugging tools to ensure their code works as it should, the increasingly complex software used by everyday PC users doesn’t.

Research like Beckwith’s may help ensure that when the industry starts adding new features for those everyday computer users, differences between men and women aren’t left out of the equation.

What’s more, making complex everyday software more accessible to women could help get more of them interested in computer science, Beckwith and Burnett believe.

As it is, the per centage of bachelor’s degrees in computer science awarded to women fell from 37 per cent in 1985 to just 22 per cent in 2005, according to the National Center for Education Statistics, even as women made gains in other science and math-based fields.

Most gender-gap theories today have more to do with computer science’s image as a haven for solitary male geeks. Industry groups and high-tech companies tend to suggest remedies like mentoring girls, and changing computer science education to better show how the field is connected to everyday topics thought to be of more interest to girls, like media, sharing and communicating.

While Beckwith and Burnett acknowledge that there are numerous social and developmental factors behind the gender gap, they say their research adds a new dimension to the debate.

“The first time you as a girl sit down at a computer to do some real problem solving,” Burnett said, “and the software you’re using isn’t a good fit for your learning style, your problem solving style, how likely are you to be to say, `I’m going to grow up and be a computer scientist?’”

Julie Jacko, a professor at the Georgia Institute of Technology and president of the Association for Computing Machinery‘s group on human-computer interaction, said research like Beckwith’s could end up changing how young women feel about computers.

“We know from our colleagues in psychology and sociology that there are gender differences that can be very important to take into account in human-computer interaction and software design,” Jacko said. “Projects like this can help us have a better impact, even at younger ages, where I believe interventions need to happen.”

The research may be early, but the software industry is paying attention. Beckwith’s first job isn’t in academia – it’s at Microsoft.

There, she’ll put her research experience to work helping the team that designs software for programmers. That group has never given much thought to the user’s gender, said Susan Todd, Beckwith’s boss-to-be.

“In the past, since we concentrate so much on developers – and as you know, there are not a lot of women developers – we haven’t really gone in that direction,” Todd said. “I think it’s going to be something that will be really quite interesting for us to look at.”

But don’t expect “Excel for Women” any time soon. Beckwith and Burnett point out that there are male computer users whose learning styles and problem-solving skills have more in common with the typical female user, and vice versa.