Hack/reduce lends a hand in Big Data security

Hack/reduce, a Boston-based nonprofit organization that acts as a springboard for Big Data projects, will host efforts to develop a security layer that would sit on top of the Hadoop open source database.

Startup Sqrrl will move into the hack/reduce office to lead the team working on the Accumulo project, Frederic Lalonde, co-founder of the non-profit and the founder of the Hopper travel site, said on Monday. Work is expected to begin soon.

Accumulo is under the open-source group The Apache Software Foundation. The data scientists who started the Apache Accumulo project also founded Sqrrl.

In general, Sqrrl is building a secure, scalable and efficient discovery layer on top of the Accumulo platform, which was originally developed by the National Security Agency (NSA).

Accumulo provides security for each cell in a table, an important function for organizations that need strict data control, such as in health care and law enforcement.

"This is the first Big Data database that's been built with security as the primary concern," Lalonde said of Sqrrl's work.

[See also: Database security - At rest, but not at risk]

Hack/reduce is scheduled to launch officially next month. On Monday, the non-profit announced that it had hired as executive director Abby Fichtner, an ex-Microsoft evangelist who was in charge of building relationships with startups.

"She was hired to run this organization, which is a full-blown nonprofit," Lalonde said. "This is not an incubator. We don't take a percentage of companies. You don't have to have a startup to come here."

Hack/reduce has raised about $3 million from venture capital firms and tech companies, such as IBM, Dell and EMC. Co-founder Chris Lynch of Atlas Venture has led the fundraising. The third founder is Steve Papa, chief executive of Endeca Technologies. Papa started Endeca in 1999 and sold it to Oracle last year.

Big Data is a loosely defined term that is used to describe the huge, complex data sets found in meteorology, genomics, biological and environmental research and many other disciplines. Because the amount of data goes beyond the capacity of traditional database management tools, researchers and startups are working on new software for slicing and dicing the data for more efficient and accurate analysis.

Part of hack/reduce's effort is to provide data sets of sufficient size for researchers to experiment on, as well as the necessary computing power. "Hack/reduce is also about creating a place where people who are passionate about the data can meet programmers interested in finding a new project to work on," Lalonde said.

Before setting up house in Boston, hack/reduce had operated since 2011 as a roving series of Hadoop hackathons organized by Hopper. The new organization will be run by a board of directors with an advisory board set up to help vet projects.

Read more about data protection in CSOonline's Data Protection section.

Join the CSO newsletter!

Error: Please check your email address.
Show Comments

Featured Whitepapers

Editor's Recommendations

Solution Centres

Stories by Antone Gonsalves

Latest Videos

  • 150x50

    CSO Webinar: The Human Factor - Your people are your biggest security weakness

    ​Speakers: David Lacey, Researcher and former CISO Royal Mail David Turner - Global Risk Management Expert Mark Guntrip - Group Manager, Email Protection, Proofpoint

    Play Video

  • 150x50

    CSO Webinar: Current ransomware defences are failing – but machine learning can drive a more proactive solution

    Speakers • Ty Miller, Director, Threat Intelligence • Mark Gregory, Leader, Network Engineering Research Group, RMIT • Jeff Lanza, Retired FBI Agent (USA) • Andy Solterbeck, VP Asia Pacific, Cylance • David Braue, CSO MC/Moderator What to expect: ​Hear from industry experts on the local and global ransomware threat landscape. Explore a new approach to dealing with ransomware using machine-learning techniques and by thinking about the problem in a fundamentally different way. Apply techniques for gathering insight into ransomware behaviour and find out what elements must go into a truly effective ransomware defence. Get a first-hand look at how ransomware actually works in practice, and how machine-learning techniques can pick up on its activities long before your employees do.

    Play Video

  • 150x50

    CSO Webinar: Get real about metadata to avoid a false sense of security

    Speakers: • Anthony Caruana – CSO MC and moderator • Ian Farquhar, Worldwide Virtual Security Team Lead, Gigamon • John Lindsay, Former CTO, iiNet • Skeeve Stevens, Futurist, Future Sumo • David Vaile - Vice chair of APF, Co-Convenor of the Cyberspace Law And Policy Community, UNSW Law Faculty This webinar covers: - A 101 on metadata - what it is and how to use it - Insight into a typical attack, what happens and what we would find when looking into the metadata - How to collect metadata, use this to detect attacks and get greater insight into how you can use this to protect your organisation - Learn how much raw data and metadata to retain and how long for - Get a reality check on how you're using your metadata and if this is enough to secure your organisation

    Play Video

  • 150x50

    CSO Webinar: How banking trojans work and how you can stop them

    CSO Webinar: How banking trojans work and how you can stop them Featuring: • John Baird, Director of Global Technology Production, Deutsche Bank • Samantha Macleod, GM Cyber Security, ME Bank • Sherrod DeGrippo, Director of Emerging Threats, Proofpoint (USA)

    Play Video

  • 150x50

    IDG Live Webinar:The right collaboration strategy will help your business take flight

    Speakers - Mike Harris, Engineering Services Manager, Jetstar - Christopher Johnson, IT Director APAC, 20th Century Fox - Brent Maxwell, Director of Information Systems, THE ICONIC - IDG MC/Moderator Anthony Caruana

    Play Video

More videos

Blog Posts

Market Place