Description
Chapter 1: IoT Testing Introduction and Quick Start Guide . A brief history of IoT technology in time and space . IoT market segments . A sampling of IoT challenges in development and testing . IoT examples of development impacts to testing . Development, testing, and operations: Systems, hardware, software, and communication-integration . Verification, validation, and testing concepts . Using integrity levels in IoT devices to allocate V&V/test approaches . Risk-based development and testing . Organizational ability levels entering into IoT dev and testing Chapter 2: IoT Test Planning, Strategy and Software Test Architecture . Introduction – IoT test planning and strategy . IoT test planning concepts . Good enough IoT software and devices . IoT test planning basics . General test planning outlines by organization classification . Pure start-up, single device, and small teams who are trying to stay alive . Mature groups or growing teams with targeting sales . Extensive system and mature group with one to more devices . IoT test planning for procuring organizations: Government, large corporation, and others . Impact of AI, data and analytics to IoT test planning . IoT test planning strategy – the traditional life cycle for hardware and software . IoT Planning for COTS hardware and software testing/integration/V&V . IoT test budgeting, estimating, and scheduling . Planning wrap-up: Regression test cases . IoT test estimation over a life cycle . Estimating schedules (goes with most cost estimates) . Estimation of testing size . Quality, verification, validation, and testing . IoT strategy and STA: The big picture starting points . Strategy and basics . System V&V planning: Start with a combination of strategies . IoT system (and system of systems) V&V test planning – A conceptual introduction . Planning the IoT test environment . Planning use of IoT tooling and automation . Data analytics with tools . Detailed test planning (what is needed below the master plans) . Planning individual tests (what testers should do daily) . Test planning documentation, presentations, and proposals . Test – Operations (Ops) impacts . How does Ops change over time? . System maintenance, security, and retirement . Retirement and disposal . Communication and integration considerations in testing . IoT operations and maintenance (O&M) with data analytics vs the Edge . Release deployment Chapter 3: IoT Security Tests and Test Techniques . IoT security assessment and testing . What is cybersecurity? . Social engineering . Security inspection and initial attack planning . Full-scale penetration of the system . Gain ongoing security access to the system . Security – To be able to recover and replace . Introduction to testing, exploration, attacks, patterns and tours . IoT test techniques, patterns and attacks – Definition . What if there is no IoT test plan (or any other plans) Chapter 4: IoT Test Automation Tools and Environments . Introduction to IoT software test architecture (STA) environments . Environments and architectures . Definition of terms for this part . Classification models of basic IoT device architectures . Classification map of IoT device architectures supporting software test . Classification of IoT device environments needing test . Defining IoT development support architectures . IoT test architecture and environment viewpoints . Example of current large scale test architecture-environment solutions . An IoT support environment: SODA – IoT edge data analytics and statistics . Test environment (Labs) creation . Level of environment vs V&V criticality . Testing the test environment . Test automation and tooling: An IoT necessity . Evolve into automation-tooling to survive IoT by learning to recognize when automation is the best choice . Automation: Test tooling areas . Math-based concepts for system and software level testing . Beyond basic automation: Attack and risk-based software test planning with exploration concepts – add tooling for attacks . Model-based testing with automation for IoT . Test execution automation – Pointer to category concept . Sample risks caused by insufficient test architectures and environments . Future research needs . Summary Appendix Appendix A: Tools pointer to web sites Appendix B: How to grow your personal tester skills Appendix C: Automation situations the newbie tester or company may face Appendix D: IoT example supporting standards Appendix E: Skills for IoT test teams Appendix F: How to grow your test planning skills Appendix G: How to grow your personal IoT test design skill – capabilities Appendix H: Situations the newbie tester or company may face in test design
