I will make the tutorial slides available after the presentation. Check back later to download.
For additional technical information, you can download the CrashScope Tool Demo and Research Papers below:
Please follow these instructions before the tutorial begins to install Android Studio (the integrated development environment, or IDE, for building Android Apps) and configure an Android emulator (a virtual device that will allow you to run and test your prototype application).
Installing Android Studio
Please visit https://developer.android.com/studio in order to download the version of Android studio for the operating system that you use. All major operating systems, including macOS, Windows, and most flavors of Linux are supported.
Follow the instructions for your specific operating system to finish the installation. You can find a detailed guide for specific operating systems here.
Configuring Your Android Emulator
Once you have installed Android studio, either navigate to the launch screen view or the code editor view in order to launch the AVD Manager. See the screenshots below to see the steps involved in doing this.
1. First click on the "Configure" button at the bottom of the splash screen.
2. Click on the "AVD Manager" option to launch the configurator for the virtual Android Devices.
3. Click on the "+ Create Virtual Device" button to launch the configurator wizard.
4. The first screen of the configurator wizard allows you to pick the hardware settings of your virtual Android device. This includes attributes such as the device screen size and pixel density. For the purposes of this tutorial, we will be using the Nexus 5 emulator, which you can select by scrolling to and clicking on the hardware configuration as shown in the above screenshot. After you have selected the Nexus 5 profile, you can click the "Next" button.
5. Next we need to configure the software that our Android emulator will run on. The wizard allows you to select from many different Android versions, some of which contain proprietary Google Play APIs. For the purposes of this tutorial, we will be using Android 7.0 (also called Nougat) as it has good compatibility across a range of Android devices. To use this version, you first click on the Download button, to download the software image. After the download is complete, you can then select the software version in the configuration wizard and click the "Next" button.
6. The Final screen of the configuration wizard provides some more advanced options and provides general information about the device you configured. For the purposes of this tutorial, we do not need to worry about advanced options, so you can simply click on the "Finish" button.
7. Now that your Android emulator has been configured, you can launch the emulator by clicking on the green "play button as indicated above. This should launch your emulator and allow you to test applications!
Downloading the Android Build Tools
In order to properly run CrashScope, you will need to download a set of the Android build tools that allow for automated extraction of app information from apks.
1. First, while at the splash Screen of Android Studio click on the "configure" button.
2. Next Click on the SDK Manager menu option.
3. Next, in the new screen that pops up, click on the SDK Tools Tab and then click on the Show Package Details button in the bottom left.
4. Next, you will need to scroll until you come across the Build Tools version
25.0.1. Click the check next to this option and then click the Apply button.
5. Finally, click the OK button on the confirmation popup that appears. You have now installed the build tools required by CrashScope.
Tutorial: Executing a Test Application with CrashScope
Today, you will be executing a test application using the CrashScope tool. To do this, you will first need to clone the CrashScope Repo, which you can find by clicking the button below. Once you have cloned the project, you can import it into the Eclipse IDE (see note below).
This tutorial is centered around using Eclipse, however, if you are experienced in setting up Java projects in other IDEs feel free to use your IDE of choice.
Step 1: Clone the CrashScope Project & Libraries
First you will need to clone the CrashScope GitHub repo. You can access the repo by using the link below.
Next, you will need to download the libraries required to run CrashScope (offered as a separated download due to licensing constraints). You can download the required libraries below. Simply download this and unpack them at the root of the CrashScope repo. The folder should named
Finally, you will need to download a test application to run with CrashScope. We will be using the Mileage application in this tutorial. You can download the Mileage
.apk file by clicking the button below.
Once, you have downloaded the Mileage application, put it in the root of the cloned CrashScope repository.
Step 2: Importing CrashScope into Eclipse
First, if you have not done so already, download Eclipse from the Eclipse Project Page, and follow the instructions for installing the IDE on your respective personal computer.
Next, you will need to import the project into Eclipse. To do this, click on the Eclipse's File menu, and then click on the Import Project option.
You should then see the screen above. Select the Existing Projects into Workspace option and then click Next.
On the next screen you should click the Browse button to locate the folder where the CrashScope repo was cloned. Then once you have selected that folder, be sure the CrashScope-Execution-Engine project is selected, and click on the Finish button.
This should import CrashScope into Eclipse where you can start to use/run it.
Step 2: Configuring CrashScope
CrashScope.java class (located in the
edu.semeru.android.testing package), you should see something like the code below in the
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17
The first thing you will need to do is replace these paths with the corresponding paths on your own personal computer according to the provided documentation.
Be sure that you add the full path of the Mileage application to the first line of the
apps.txt file, so that CrashScope knows where to find the app.
Additionally, in the same class, in the
runCrashScopeLocal method you will see the following:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
You will also need to do is replace these paths with the corresponding paths on your own personal computer according to the provided documentation.
Step 2: Running CrashScope
Now that you have configured all the relevant paths, it is time to run CrashScope on the Mileage app!
Launch your configured emulator by clicking on the green start button in the Android Studio AVD manager. (Refer to the setup instructions for additional details).
Next, you will need to run the
main method in the
CrashScope.java file. To do this, Right click the
CrashScope.java file in the Eclipse File explorer, and then select Run as -> Java Application.
This will start the Execution of CrashScope on the Mileage application!
Final Step: Congratulations!
Congrats on running your first app with CrashScope. You will find the output of the technique in your
CrashScope-Data folder, which will include screenshots of each step, as well as a .json file that contains all of the information for a given execution.
We hope that future researchers will build upon CrashScope for AR/VR/XR applicaitons by replacing the
uiautomator interface, which fetches information regarding native Android app GUIs, with Computer Vision techniques that can reliably detect various interface components for AR/VR/XR applications.