Lab 7: Arc Collector

An Introduction to gathering geospatial data on a mobile device, such as a tablet or smartphone

Introduction

Since most people always have a smart phone or tablet on them at all times, using these devices to collect spatial data can be very easy and effective. This lab is an introduction to gathering geospatial data on a mobile device using the App Arc Collector. On October 24, 2017 teams were sent out across the UWEC campus to collect weather data such as wind speed, temperature, dew point, and others. Using ArcCollector, all data was collected with a specific geographic point on campus.

Study Area

Data was collected on the UWEC campus. As shown in Figure 1, the campus was divided into zones. Teams of 2-4 students were sent to each zone. 

Figure 1: Study Area Map

Methods

Dr. Hupy created the private group "Geog336Micro_Section01" on ArcGIS online as well as a survey for the App ArcCollector. This App is described in Lab 5: Using a Bluetooth GPS with an iOS Device. Students downloaded ArcCollector, logged onto ArcGIS online group "Geog336Micro_Section01" to access the survey. 

Students were divided into groups of 2-4 and sent out into different zones on campus to collect weather data in their zone. Criteria collected included Temperature (Degrees Fahrenheit), Dew Point (Degrees Celsius), Wind Chill (Degrees Fahrenheit), Wind Speed (Miles per Hour), and Wind Direction (Azimuth). The first four pieces of data were collected with the Kestrel 3000, as pictured in figure 2. Wind Direction was collected with a flag and Geographer's Compass, pictured in figure 3.

Figure 2: Kestrel 3000

Figure 3: Geographers Compass

Using ArcCollector is fairly simple. Figure 4 shows the map screen, used to determine geographic location. The green dots indicate points where data has been collected and the larger grey dot indicates the current location. To add a data point click the plus sign on the bottom ribbon. This will open the survey screen, figure 5. Using the phone's GPS, the location is automatically recorded. The user must then complete the survey. There was a preset range of inputs to be selected for each field. Once all the fields are completed, click the check mark on the upper ribbon to upload the data. Data is added to the map in real time as it is collected.

Figure 4: ArcCollector Map Screen. Green dots are collected points. Larger grey dot is current location. Plus sign on the bottom ribbon opens the survey pages.

Figure 5: ArcCollector Survey Page. Fill out each field at each location, click the check mark to confirm and upload data to map. 

Once all the data is collected, it can be downloaded from ArcGIS online and represented in ArcMap.

Discussion

Temperature

The lowest temperature values collected on this day are those collected nearest the river. 

Figure 6: Temperature Map

Wind Chill

Wind chill temperatures are coldest near the river where the temperatures are lower and wind speeds are the greatest. 

Figure 7: Wind Chill Temperatures Map

Dew Point

Dew point is the atmospheric temperature below which water droplets begin to condense and dew can form. Dew point varies according to pressure and humidity. Dew point appears to be greatest near the river on the eastern end of zone two. 

Figure 8: Dew Point Map

Wind Speed and Direction

Wind speeds tend to be greater closer to the river. Visually, wind direction trends to the northwest. Statistically, the mean azimuth is 228 degrees, which is to the southwest. However, when looking at the frequency distribution, most values are greater than 250 degrees. The scattering of azimuths collected less than 250 degrees could be due to eddy currents generated as the wind flows around a building.

Figure 9: Wind Speed and Direction Map

Figure 10: Wind Direction Statistics

Conclusions

The lab effectively demonstrated the simplicity of using ArcCollector on mobile devices to collect geospatial data. The smartphone GPS was accurate enough to pinpoint locations, and the survey was simple to fill out and upload. Data was displayed in real time even as data was collected from multiple devices simultaneously. 

Lab 6: Survey123

Introduction

Survey 123 for ArcGIS is a geographic survey tool that allows the user to design a survey and share it with multiple users. The users can complete the survey, responding with accurate geographic data from their cell phones. There are multiple applications of this tool, one of them including disaster assessment. First responders can collect data in the field designating primary and secondary emergencies and create a map, in real time, of the affected area and its needs.

In this lab, I will be completing a Survey123 tutorial where I will create a survey on the Survey 123 for ArcGIS website, submit the survey, analyze the results, and share the results.

Let's get Started

First I navigated to the Learn ArcGIS online lesson gallery, logged on with my enterprise account, and searched for "Get started with Survey123 for ArcGIS."

Create a Survey

In this survey tutorial, I will be creating a disaster preparedness survey for a Home Owners Association (HOA). Members of the association will complete the survey.

Start designing the survey

Click "Create New Survey," choose "Using the Web Designer" and click "Get Started." In the "Create New Survey" window, I populated the blanks as shown in Figure #. 
Add general participant information questions 

Q1: Under "Common Questions" set, I add date. I fix the answer to submitting date and make it a required question.
Q2: Next, I add a response box for "Participant Name" by adding a "Singleline Text" question to the survey. I also made this a required question.
Q3: I added another "Singline Text" question for "Participant Location." Under hint I wrote "e.g. Address, street name, nearest cross streets" encouraging residents to include full address, but allowing other options for residents who did not feel comfortable sharing that information. 
Q4: Finally, I added a "GeoPoint" question which provides a map and allows users to pinpoint their location. I added a Hint informing residents that they could select the nearest cross streets if they did not feel comfortable locating their homes. I selected "Imagery with Labels" as the base map and made the question required.  

Add questions about the participant's residence

Q5: I used a "Single Choice" question to ask about the type of home, single family (home) or multi-family (apartment or condo) and included an "other" box for participants to include another type of home.

Q6: Next, I used "Number" question to ask how many levels the home has, including a hint to count the basement separately. I also placed a rule on Q5 so that Q6 only appears if "Single family" is selected.

Q7: Another "Number" question was added to ask "Approximately what year was your residence built?" and under "Validation" required that a the response must "Be an integer."

Q8: Using the "Image" question, I allow participants to upload a photo of their home with the following note: "This will help assess building materials and structural integrity. Be advised: For security reasons, please do not share pictures with personally identifiable elements such as house numbers or car license plates."

Q9: Another "Number" question with required integer response was added to ask "How many people live in your home."

Q10: Finally, I included an "Multi Choice" question inquiring the age range of people in the home. There were four options and the participant was informed to check all that apply. For layout, I selected horizontal.

Add questions for the 9 Fix-it safety checks

There are 9 Fix-it safety checks

Add questions for an inventory of emergency assets

Publish the survey

Lab 5: Using a Bluetooth GPS with an iOS Device

Introduction

More and more often, GPS units and other geographic equipment are compatible with or dependent on cell phones, laptops, and tablets as an interface tool. The two devices connect via Bluetooth. Purchasable applications are faster and cheaper to update than a GPS unit. This lab explores some of the GIS/Mapping apps compatible with the Bad Elf GPS, pictured in figure 1. 

Figure 1: Bad Elf GPS

I do not have an iOS device, so I could not download the Bad Elf GPS App, nor did I have an opportunity to explore the App. Based on its website, the App can manage your trip (data collected with the GPS), and display it over a basemap (even without an internet connection). It can record and map changes in altitude, distance, and speed, and perform a variety of other functions.

There are a variety of other Apps compatible with Bad Elf, all of which can be found on the Bad Elf website, see Figure 2. 

Figure 2: Navigating to Compatible Apps. Solutions > Compatible Apps.

The table below lists and describes some of the many interesting compatible apps.

Compatible App	Key Features
Collector	Use maps anywhere to ground truth your data, make observations, and respond to events. You'll improve the efficiency of your field workforce and the accuracy of your GIS. Features: -          Collect and update data using the map or GPS (even in the background) -          Download maps to your device and work offline -          Collect points, lines, areas, and related data -          Fill out easy-to-use, map-driven forms -          Attach photos to your features -          Use professional-grade GPS receivers -          Search for places and features -          Track and report where you've been -          Integrate with Navigator for ArcGIS -          Integrate with Workforce for ArcGIS https://itunes.apple.com/us/app/collector-for-arcgis/id589674237?mt=8
Survey 123	Survey123 for ArcGIS is a simple form-centric data collection GIS app. Using your ArcGIS organizational account you will be able to login into the app and download any forms that may have been shared with you. Once a form is downloaded, you will be able to start collecting data. If working offline, your completed forms will be saved locally. https://itunes.apple.com/us/app/survey123-for-arcgis/id993015031?mt=8
GIS4Mobile	GIS4Mobile is the most flexible and user friendly way to connect you enterprise GIS with workers in the field. Inspections, documentation, data-collections and registration - all is possible with GIS4Mobile. Data you collect is stored on our safe servers. It is possible to connect your own private storage, and it is possible to synchronize you GIS data with the collected field data. And remember - getting help from GIS4Mobile is free of charge. https://itunes.apple.com/us/app/gis4mobile-x/id1080570270?mt=8
Theodolite	Theodolite HD is a multi-function viewfinder for iPad and iPad mini that combines a compass, two-axis inclinometer, rangefinder, GPS, map, nav calculator, tracker, and geo-tag photo/movie camera into one indispensable app. Uses are endless, and the app is great for hiking, boating, hunting, golf, outdoor sports, sightseeing, navigation, and finding your way around. Theodolite is used extensively by surveyors, geologists, architects, engineers, competitive sportsmen, first responders, military personnel, and search and rescue workers around the world. https://itunes.apple.com/us/app/theodolite-hd/id425456242?mt=8
Gaia GPS	Plan trips and stay safer in the woods, with Gaia GPS. Used by hundreds of thousands of backpackers, hunters, offroaders, firefighters, guides, and other serious outdoor adventurers and professionals, Gaia GPS offers the best outdoor maps and navigation tools. Features -          import and export GPX/KML files, by iTunes, Safari, DropBox, and email -          download worldwide topo, road, and satellite maps -          display all of your tracks, routes, areas, and waypoints on the map
Galileo Offline Maps	Go offline anywhere you want — offline vector maps and offline search for your better travel experience. Record your GPS tracks, bookmark your favorite locations and sync them between your devices. Features -          Works in variety of ways – by object name, category or even by GPS coordinates. -          Monitor your real-time speed, distance and time traveled, as well as altitude right on the map during the trip. -          Finds objects in multiple languages – this will make your searching much easier than ever. -          No internet connection required. -          Record your trips and export them as KML/GPX files.
Fog of World App	Fog of World is a real-life game that you need to remove the fog on the map by exploring the world. It's a fantastic way to visualize everywhere you have been in your entire life. Features -          Records your tracks (even when the app running in the background). -          Shows everywhere you have been on the map at the same time. -          Analyses your statistics around the world, around every continent, and around every country and territory. -          Lots of badges to motivate you to explore more around the world. -          Support for Importing tracks through GPX or KML files. -          - Support for syncing your data with iCloud or Dropbox.
Maps.Me	Free, fast, detailed and entirely offline maps with turn-by-turn navigation. Use driving, walking and cycle navigation anywhere in the world. Maps are updated by millions of OpenStreetMap contributors daily. OSM is an open-source alternative to Google Maps and Apple Maps. Save locations you love and share them with your friends. *As a side note, I used this App while traveling China, where google maps was not optimized and my only internet access was coffee shop WiFi* https://itunes.apple.com/us/app/maps.me-offline-map-navigation/id510623322?mt=8

Methods

Once the Bad Elf GPS and cell phone are connected via bluetooth, we hit the start logging button on the GPS. Then we went for a 10 minute walk around campus, and turned off the logging function. In the cell phone on the Bad Elf App we downloaded our "trip". It was very easy to click on and share our trip via email, in a variety of formats. I imported the trip into ArcMap and made a map, as shown in figure 3.

Discussion

As mentioned in the introduction, more and more geospatial data collection instruments are moving in a direction of cell phone compatibility. Cellphone, tablet, and computer companies are focused on the advancement of their product, which is rapid and leaving two-year-old products obsolete. Geospatial data collection companies cannot keep up, so they have teamed up. Companies are making cellphone and tablet applications that are compatible with their GPS units to function as the interface platform. This is good for the geographer who can carry around less equipment and spend less money on technology upgrades.

Figure 3: Me at the Great Wall of China. I used Maps.Me to navigate through Bejing and Chengdu without internet, or Google Maps, which is blocked there.

Lab 4: Development of a Field Navigation Map

Introduction

On November 4th, 2017 we will be going out to The Priory to conduct Lab 8: Navigation with Map and Compass where we will learn to navigate with a map and compass. In preparation for that lab, I will develop a Field Navigation Map. I will create two maps, one with a Geographic Coordinates grid and one with a UTM grid, in ArcMap using data provided by Dr. Hupy. The Priory Study Area is shown in reference to UWEC Phillips Science Hall in Image 1.

Image 1: UWEC The Priory

Background

Coordinate Systems

Since the earth is round, it is impossible to perfectly accurately represent the earth's surface on a flat map. However, clever coordinate systems are employed to more accurate representation. There are an innumerable amount of coordinate systems and projects available based on location, scale, and map purpose, each with its own pros and cons. In order to create my navigation maps, I employed a geographic coordinate system and a Universal Transverse Mercator zone system.

Geographic Coordinates

According to Esri, a geographic coordinate system (GCS) utilizes a three-dimensional sphereical surface to define locations on the earth. Each point is referenced via its latitude and longitude values, angles measured (often in degrees) from the center of the earth to that point. 

The GCS I used to create my maps is GCS_WGS_1984.

Figure 1: Globe with latitude and longitude values.

Universal Transverse Mercator

Universal Transverse Mercator (UTM) is a coordinate system where the globe is divided into 60 north and south zones with an independent coordinate system whose origin is the the equator and the zone's central meridian. The zones span 6 degrees of longitude. To prevent negative numbers, the system utilizes a false easting of 500,000 meters.  Figure 2 shows the UTM zones across the conterminous U.S.

The UTM coordinate system I utilized to create my maps in this project is NAD_1983_UTM_Zone_15N.

Figure 2: UTM zones across the conterminous U.S.

Methods

Data Provided

In ArcCatalog I explored the data provided which included a USGS map of Eau Claire, two aerial photographs of Eau Claire, a DEM of western Wisconsin, elevation labels, three Lidar rasters of the study area, a polygon delineating the study area, as well as 2ft contours of the study area. Between the 11 data files provided, there are four coordinate systems represented as well as 3 undefined data files. Follow this link to preview the data provided: https://universityofwieauclaire-my.sharepoint.com/personal/kubishme_uwec_edu/_layouts/15/guestaccess.aspx?docid=05b256c299eb34266a937f20f727813cc&authkey=AbuWcL0kHrcMAfKc1F4o5nU

Data Preparation

As noted, the data provided were not all in the same coordinate systems and so my first step in preparing the data is to put them all in the same coordinate system. In ArcMap, I added Lidar062609NE, which has a spatial reference of NAD_1983_HARN_WISCRS_EauClaire_County_Feet, to my data frame. I then added LidarNE and LidarNW, whose spatial reference is undefined. Since they lined up next to Lidar062609NE so well and were probably collected during the same survey, I can assume that they should have the same spatial reference. In the search window I search "project" and use the tool "Define Projection" to define both LidarNW and LidarNE spatial reference as NAD_1983_HARN_WISCRS_EauClaire_County_Feet.

I would like these three Lidar rasters to be combined into a single raster, so in the search window I search "Mosiac To New Raster." I use all three lidar data sets to create a single data set named "LidarPriory". Be sure that the specs of the old raster match the new one: Pixel Type should be 32 Unsigned and the Number of Bands should be 1.

Using the "Hillshade" tool I then created a shaded relief raster from "LidarPriory". This will serve as the background for my UTM map.

I created duplicates of "Navigationboundary", "Hillshade", and "Eau_Claire_West_SE" files projected in both GCS_WGS_1984 and UTM Zone 15N. 

Layout Setup

In the Page and Print Setup window, I make sure that the paper size is 11x17in and in Landscape view.

For the UTM Map, I set up a grid with 50m spacing and selected "Hillshade" as the basemap.

For the GCS Map, I set up a grid displaying geographic coordinates in Decimal Degrees.

Results

Map 1: Global Coordinate System Navigation Map Closer Look

Map 2: UTM Navigation Map Closer Look

Conclusions

Based on my experience at UWEC's Geology Field Camps I and II, a map with an aerial photograph is extremely useful for navigating via landmarks and visualizing the larger map area. However, they are painful to record data on. Presuming that we may need to mark on these maps and that our GPS will provide location data with UTM coordinates, I selected the more neutral Hillshade background for my UTM map. This map also nicely highlights topographic changes in the landscape that the aerial map does not. The GCS map utilizes the aerial imagery. I chose not to employ contour lines because of the relatively minimal elevation changes.

During and after the field trip I will be able to access if my presumptions have been reasonable or accurate. 

Lab 3: Evaluation of UAS Platforms and GPS Units for Ground Control

Introduction

On Saturday September 30 our class went out to Litchfield Mine to evaluate Unmanned Aerial System (UAS) platforms and Global Positioning System units for ground control. Litchfield mine is an aggregate mine located southwest of Eau Claire on the Chippewa River. The mine's product is sorted and stockpiled. To collect inventory of this product, the volume of the stockpiles need to be measured. One safe method to do this is through aerial photography. Data is collected with a UAS platform and analyzed with GIS. We collected data during this lab, the data will be analyzed in a later lab. Professor Hupy invited professionals from Menet Aero and Topcon Solutions to join us in the field and show us a variety of UAS and GPS platforms allowing to compare and contrast a variety of equipment. The focus of this lab is to compare the different units collecting data to be used in a later lab. 

Study Area

The study area was Litchfield Mine, an aggregate mine southwest of Eau Claire, Wisconsin on the Chippewa River, see location Map 1. They mine Quaternary Alluvium on the banks of the Chippewa river. 

Map 1: Study Area

Methods

Select Ground Control Points

Selecting ground good ground control points (GCP) is key for UAS surveys. They will ensure that all images collected by UAS equipment are accurately georeferenced. Our first task of the day was to place 16 ground control points. Our points were large foam checkered squares placed on the ground and spray-painted with their site number. These squares will be visible from the height that the UAS equipment will be flying. Our GCPs were placed throughout the study on a variety of surfaces (grass, gravel) and variety of elevations. It is best to make triangles with the GCPs, they should not be in a straight line. When placing GCPs keep detailed notes about the placement location and draw a field map.

Figure 1: Maike with unplaced GCP

Menet Aero provided AeroPoints Propeller GPS markers, Figure 2. These 2x2 foot foam pads are dubbed a "smart target". They are GCPs that include an internal GPS powered by solar. They communicate with eachother and with satellites, sending their data directly to the cloud. Their accuracy is within 2-6cm of actual position. They are lightweight, water proof, and are not damaged when driven over. Some disadvantages of using AeroPoints as a method for GCPs, is that there is that real-time data is not accessible in the field. Additionally these markers are $500 a piece, so the number of GCP in a UAS survey is limited by budget.  

Figure 2: AeroPoint Propeller GCP. The foam mat at the base of the GPS system.

Survey Ground Control Points

Once all GCPs have been placed, collect their GPS coordinates. The most accurate coordinates will be used in a later lab to georeference the UAS images. We collected GPS coordinates using a variety of equipment including the Trimble R2, Septentrio Altus NR2, Topcon HiPer, Bad Elf GPS units, and our personal cell phones. When collecting this data, it is imperative that the GPS unit is as close to the cross of the GCP as possible, as seen in Figure 3.

The Trimble R2, Septentrio Altus NR2, and Topcon HiPer were all similar pieces of equipment. Once located directly atop the GCP and leveled, geographic data was collected with an interface screen attached to the unit. See Figures 4 and 5.

Figure 3: GPS units Topcon HiPer and Bad Elf positioned as close to the cross of the GCP as possible.

Figure 4: Allison using the Topcon HiPer interface Screen.

Figure 5 shows the Topcon HiPer interface screen which shows preloaded imagery of the location as well as satellite and WiFi signal strength. Once data collection begins at each point, watch the screen for fluctuations of satellite and WiFi strength - if signal becomes poor stop and collect at that point again. After thirty seconds of data collection with optimal satellite and WiFi, click stop and save. All coordinates collected during that time are averaged and recorded in a spreadsheet. Professor Hupy will provide the class with that data after the lab.

Figure 5: Topcon HiPer interface Screen.

We also collected GPS coordinates with the handheld Bad Elf GPS units and our personal cell phones. We placed these as close to the center of the GCP cross point (Figure 3) and recorded the coordinates in our notes.

Conduct UAS Survey

Four UAS were used to conduct a survey of the study area, the DJI Phantom 3 Pro, Sensefly Ebee, M600 Pro, and C-Astral Bramor. Each platform varies in UAS type (rotary/fixed wing), takeoff and landing procedures, and specs. All followed a similar procedure however. Platform takeoff and landing locations were selected and cleared of people and obstacles, and then the flight plan was programmed on a laptop or ipad. All UAS utilized a pre-planned flight plan, as manual fight invalidated the UAS warrenty. All UAS were operated by the visiting industry professionals.

DJI Phantom 3 Pro

The DJI Phantom 3 Pro was a small rotary wing UAS with 30 minutes of available flight time. It takes 1 hour to charge the battery. The flight was planned with a programmable controller attached to an Ipad. This UAS took off and landed in the same location.

Video 1: Takeoff of the DJI Phantom 3 Pro

Figure 6: DJI Phantom 3 Pro controller Ipad Interface

Sensefly Ebee

This UAS was a fixed wing foam unit with internal compartments that housed a camera and tracking device, see Figures 7 and 8. Fixed wing platforms like this one can cover more ground on the same battery time. Its battery lasts for 59 minutes of flight and can handle up to 28mph wind speed. It is programmed to return home in the event of poor GPS signal, high wind speed, or poor connection to the controller. When photos are collected, the motor on the unit briefly turns off. The flight was planned on a laptop in the field with pre-loaded background imagery. Take off is via hand launch, see video 2. Landing is a controlled crash, as the unit flys at a shallow angle down a landing strip until it stops. A disadvantage of this unit then, is that it requires a significant amount of space to land and is not optimal in locations with tight spaces. 

Figure 7: Underside of Sensefly Ebee

Figure 8: Topside of Sensefly Ebee

Video 2: Takeoff of Sensefly Ebee

M600 Pro with GeoSnap Pro

This larger, rotary wing unit takesoff and lands in the same location. It features a reliable camera that is separate from platform. During flight planning, it accounts for photograph size and you can directly control photograph overlay in the field.

Figure 9: Closeup of the M600 Pro

Video 3: Landing of the M600 Pro

C-Astral Bramor w/Sony a6000

This is another fixed wing unit, but it is made out of hard plastic and very much resembles a small commercial air plane. It is launched with a large crafted slingshot (See Figure 10) and lands via parachute. This means that there is less control over where the unit will land. Another disadvantage is that is the parachute mechanism malfunctions the unit will crash and may be damaged beyond repair.

Figure 10: C-Astral Bramor slingshot takeoff gear

Conclusions

There are a variety of methods and technology available to collect data necessary to conduct volume-metric surveys of the Litchfield stockpiles. Each unit has its own pros and cons depending on the type of survey being conducted, accuracy and precision of data desired, and budget. In depth pros and cons of each unit is described under methodology. For example however cell phone GPS coordinates may be accurate enough for me to navigate to the mine, but is not accurate enough to pin down a GCP.

Most of the data collected during this lab is not yet available to students. However, this spreadsheet details the GCP coordinates collected via Bad Elf and personal cellphones.