Application security testing

The current state of application security testing

This article provides you with an overview of the current state of application security testing. Some of the challenges with application security testing include ensuring adequate coverage of black-box application testing, false negative issues with white box testing using automated source code analysis software and the lack of experience in the security industry with testing of client side applications.

With standard black box web application penetration tests the tester is given no access to source code or design documentation and given only some URLs and Login IDs and passwords. The challenge is that without comprehensive criteria and custom test cases written from a threat modelling perspective to test to the tester will only look for common "low hanging fruit" and issues they know to look for (ie OWASP top 10) and miss more obscure but more important issues related to application business logic. Also without access to the source code developing "paint by numbers" recommendations to close the vulnerabilities identified is difficult.

Read more on application security: Opinions: The sorry state of application security

With white box security testing the tester is provided with source code, design documentation and can ask the developer questions. Often there is too much code to review manually so Source Code Analysis software (SCA) is utilised to provide coverage. The current challenge is that SCA only assists an application security specialist not replaces them. Often new "vulnerability signatures" need to be written or existing ones modified to capture the vulnerabilities in the first place. Then these signatures can be searched for across the whole codebase providing a fair degree of coverage. SCA software allows searching of code and tracing the flow of input through an application. Often SCA can be used to successfully find all instances of issues identified via black box "pen tests".

There is a reasonable degree of experience in the wider information security community related to web application security these days. Most security consultants are aware of most of the key security controls which address the most commonly encountered vulnerabilities. This is because web applications are often custom developed for each client, often internet facing, hence at higher risk and often requested to be tested. Source code is often available, but access to it by the end customer is often restricted for commercial purposes. 

With compiled executable applications installed on end user computers like web browsers, PDF readers, word processors, media players and other COTS applications there are additional challenges.  The end customer and hence the security tester employed by them; doesn't have access to the source code; is often legally restricted from reverse engineering the application and legal hell will be oft rained down upon them if they dare reporting security vulnerabilities for remediation.  This provides challenges to the enterprise as these applications are often the target of cyber criminals who exploit vulnerabilities in these commonly deployed applications to deploy remote access trojans, rootkits, key-loggers and the like via vectors such as malicious web sites and email attachments. 

Read more on application security in CSO's Application security section

About the Author:

Matthew Hackling

Matthew Hackling B.Sc. (Security) CISSP

Matthew has over ten years experience operating solely in the area of information security, holds a Bachelors degree in security management from ECU and is also a CISSP. He is a former Account Director in Deloitte's Security & Privacy Services practice. Matthew has led security testing teams on assessments of large core systems replacement projects for banking institutions. He operates more in the area of information security governance these days, despite his urges still stay a bit technical. Hence he plays with backtrack linux, metasploit and new web application security assessment tools in his rare free time. Currently he runs his own consultancy called Ronin Security Consulting and holds the title of General Manager of Security Testing at Enex TestLab. He is an active member of the Australian Information Security Association, and held the office of Melbourne Branch Executive for a number of years. Matt's security blog is called Infamous Agenda and he is an active twitter user with the handle @mhackling

Follow CSO Australia on Twitter: @CSO_Australia

Join the CSO newsletter!

Error: Please check your email address.

Tags Penetration testingOpinionssecurity industryapplication securitywhite box securitySource Code Analysis software (SCA)

More about CA TechnologiesEnex TestLab

Show Comments

Featured Whitepapers

Editor's Recommendations

Solution Centres

Stories by Matthew Hackling

Latest Videos

  • 150x50

    CSO Webinar: The Human Factor - Your people are your biggest security weakness

    ​Speakers: David Lacey, Researcher and former CISO Royal Mail David Turner - Global Risk Management Expert Mark Guntrip - Group Manager, Email Protection, Proofpoint

    Play Video

  • 150x50

    CSO Webinar: Current ransomware defences are failing – but machine learning can drive a more proactive solution

    Speakers • Ty Miller, Director, Threat Intelligence • Mark Gregory, Leader, Network Engineering Research Group, RMIT • Jeff Lanza, Retired FBI Agent (USA) • Andy Solterbeck, VP Asia Pacific, Cylance • David Braue, CSO MC/Moderator What to expect: ​Hear from industry experts on the local and global ransomware threat landscape. Explore a new approach to dealing with ransomware using machine-learning techniques and by thinking about the problem in a fundamentally different way. Apply techniques for gathering insight into ransomware behaviour and find out what elements must go into a truly effective ransomware defence. Get a first-hand look at how ransomware actually works in practice, and how machine-learning techniques can pick up on its activities long before your employees do.

    Play Video

  • 150x50

    CSO Webinar: Get real about metadata to avoid a false sense of security

    Speakers: • Anthony Caruana – CSO MC and moderator • Ian Farquhar, Worldwide Virtual Security Team Lead, Gigamon • John Lindsay, Former CTO, iiNet • Skeeve Stevens, Futurist, Future Sumo • David Vaile - Vice chair of APF, Co-Convenor of the Cyberspace Law And Policy Community, UNSW Law Faculty This webinar covers: - A 101 on metadata - what it is and how to use it - Insight into a typical attack, what happens and what we would find when looking into the metadata - How to collect metadata, use this to detect attacks and get greater insight into how you can use this to protect your organisation - Learn how much raw data and metadata to retain and how long for - Get a reality check on how you're using your metadata and if this is enough to secure your organisation

    Play Video

  • 150x50

    CSO Webinar: How banking trojans work and how you can stop them

    CSO Webinar: How banking trojans work and how you can stop them Featuring: • John Baird, Director of Global Technology Production, Deutsche Bank • Samantha Macleod, GM Cyber Security, ME Bank • Sherrod DeGrippo, Director of Emerging Threats, Proofpoint (USA)

    Play Video

  • 150x50

    IDG Live Webinar:The right collaboration strategy will help your business take flight

    Speakers - Mike Harris, Engineering Services Manager, Jetstar - Christopher Johnson, IT Director APAC, 20th Century Fox - Brent Maxwell, Director of Information Systems, THE ICONIC - IDG MC/Moderator Anthony Caruana

    Play Video

More videos

Blog Posts