Sometimes a basic solid color for your map's labels and text just isn't going to cut it. Here is an ArcGIS Pro style with light and dark gradient fills and shadow/glow effects that you can apply to map text via the "Text fill symbol" picker in your label pane. Level up those labels! Make them look touchable. Glassy. Shady. Intriguing.Find a how-to here.Save this style, add it to your ArcGIS Pro project, then use it for any text (including labels).**UPDATE**I've added a symbol that makes text look like is being illuminated from below, casting a shadow upwards and behind. Pretty dramatic if you ask me. Here is an example:Happy Mapping! John Nelson

The way to access Layers Quickly.

Quick Layers is an Add-In for ArcGIS Pro 3 that allows rapid access to the DNR's Geospatial Data Resource Site (GDRS). The GDRS is a data structure that serves core geospatial dataset and applications for not only DNR, but many state agencies, and supports the Minnesota Geospatial Commons. Data added from Quick Layers is pre-symbolized, helping to standardize visualization and map production. Current version: 3.11

To use Quick Layers with the GDRS, there's no need to download QuickLayers from this location. Instead, download a full copy or a custom subset of the public GDRS (including Quick Layers for ArcGIS Pro 3) using GDRS Manager.

Quick Layers also allows users to save and share their own pre-symbolized layers, thus increasing efficiency and consistency across the enterprise.

Installation:

After using GDRS Manager to create a GDRS, including Quick Layers, add the path to the Quick Layers addin to the list of shared folders:
1. Open ArcGIS Pro
2. Project -> Add-In Manager -> Options
3. Click add folder, and enter the location of the Quick Layers Pro app. For example, if your GDRS is mapped to the V drive, the path would be V:\gdrs\apps\pub\us_mn_state_dnr\quick_layers_pro3
4. After you do this, the Quick Layers ribbon will be available. To also add Quick Layers to the Quick Access Toolbar at the top, right click Quick Layers, and select Add to Quick Access Toolbar

The link below is only for those who are using Quick Layers without a GDRS. To get the most functionality out of Quick Layers, don't install it separately, but instead download it as part of a GDRS build using GDRS Manager.

Did you know that George Washington was a cartographer? He was a surveyor and map maker in his early years, and continued to make his own maps for practical purposes throughout his life. Cool, right?George's StyleHere is a map he made of his farm, just dripping with hand-wrought charm:The ArcGIS Pro style available here is compiled of material textures and George's hand-drawn elements sampled from this very map. That means, when you use it, your map is wrought in the very hand of George Washington. What a time to be alive.Check out these examples that Ernst Eijkelenboom whipped up of his native Netherlands...Glorious.What You GetAre you ready to cartographicize like the first president of the United States? Here's what you'll find in the style...How to Install?Save this style file somewhere on your computer. Then, in Pro, open up the Catalog view, and expand the Style category. Right-click, and choose “Add.” Then just browse to where you saved George Washington. Pow! You’ll be whipping up maps that look like they were scribed by the right hand (I surmise, based on the way his trees lean) of George, himself.If you would like to make your own styles, based on the texture images I extracted from George’s map, then you can have at them here.Happy Presidential Throwback Mapping! John Nelson

Purpose: This is an ArcGIS Pro template that GIS Specialists can use to identify vulnerable populations and special needs infrastructure most at risk to flooding events.How does it work?Determine and understand the Place Vulnerability (based on Cutter et al. 1997) and the Special Needs Infrastructure for an area of interest based on Special Flood Hazard Zones, Social Vulnerability Index, and the distribution of its Population and Housing units. The final product will be charts of the data distribution and a Hosted Feature Layer. See this Story Map example for a more detailed explanation.This uses the FEMA National Flood Hazard Layer as an input (although you can substitute your own flood hazard data), check availability for your County before beginning the Task: FEMA NFHL ViewerThe solution consists of several tasks that allow you to:Select an area of interest for your Place Vulnerability Analysis. Select a Hazard that may occur within your area of interest.Select the Social Vulnerability Index (SVI) features contained within your area of interest using the CDC’s Social Vulnerability Index (SVI) – 2016 overall SVI layer at the census tract level in the map.Determine and understand the Social Vulnerability Index for the hazard zones identified within you area of interest.Identify the Special Needs Infrastructure features located within the hazard zones identified within you area of interest.Share your data to ArcGIS Online as a Hosted Feature Layer.FIRST STEPS:Create a folder C:\GIS\ if you do not already have this folder created. (This is a suggested step as the ArcGIS Pro Tasks does not appear to keep relative paths)Download the ZIP file.Extract the ZIP file and save it to the C:\GIS\ location on your computer. Open the PlaceVulnerabilityAnalysis.aprx file.Once the Project file (.aprx) opens, we suggest the following setup to easily view the Tasks instructions, the Map and its Contents, and the Databases (.gdb) from the Catalog pane.The following public web map is included as a Template in the ArcGIS Pro solution file: Place Vulnerability Template Web MapNote 1:As this is a beta version, please take note of some pain points:Data input and output locations may need to be manually populated from the related workspaces (.gdb) or the tools may fail to run. Make sure to unzip/extract the file to the C:\GIS\ location on your computer to avoid issues.Switching from one step to the next may not be totally seamless yet.If you are experiencing any issues with the Flood Hazard Zones service provided, or if the data is not available for your area of interest, you can also download your Flood Hazard Zones data from the FEMA Flood Map Service Center. In the search, use the FEMA ID. Once downloaded, save the data in your project folder and use it as an input.Note 2:In this task, the default hazard being used are the National Flood Hazard Zones. If you would like to use a different hazard, you will need to add the new hazard layer to the map and update all query expressions accordingly.For questions, bug reports, or new requirements contact pdoherty@publicsafetygis.org

Statewide 2016 Lidar points colorized with 2018 NAIP imagery as a scene created by Esri using ArcGIS Pro for the entire State of Connecticut. This service provides the colorized Lidar point in interactive 3D for visualization, interaction of the ability to make measurements without downloading.Lidar is referenced at https://cteco.uconn.edu/data/lidar/ and can be downloaded at https://cteco.uconn.edu/data/download/flight2016/. Metadata: https://cteco.uconn.edu/data/flight2016/info.htm#metadata. The Connecticut 2016 Lidar was captured between March 11, 2016 and April 16, 2016. Is covers 5,240 sq miles and is divided into 23, 381 tiles. It was acquired by the Captiol Region Council of Governments with funding from multiple state agencies. It was flown and processed by Sanborn. The delivery included classified point clouds and 1 meter QL2 DEMs. The 2016 Lidar is published on the Connecticut Environmental Conditions Online (CT ECO) website. CT ECO is the collaborative work of the Connecticut Department of Energy and Environmental Protection (DEEP) and the University of Connecticut Center for Land Use Education and Research (CLEAR) to share environmental and natural resource information with the general public. CT ECO's mission is to encourage, support, and promote informed land use and development decisions in Connecticut by providing local, state and federal agencies, and the public with convenient access to the most up-to-date and complete natural resource information available statewide.Process used:Extract Building Footprints from Lidar1. Prepare Lidar - Download 2016 Lidar from CT ECO- Create LAS Dataset2. Extract Building Footprints from LidarUse the LAS Dataset in the Classify Las Building Tool in ArcGIS Pro 2.4.Colorize LidarColorizing the Lidar points means that each point in the point cloud is given a color based on the imagery color value at that exact location.1. Prepare Imagery- Acquire 2018 NAIP tif tiles from UConn (originally from USDA NRCS).- Create mosaic dataset of the NAIP imagery.2. Prepare and Analyze Lidar Points- Change the coordinate system of each of the lidar tiles to the Projected Coordinate System CT NAD 83 (2011) Feet (EPSG 6434). This is because the downloaded tiles come in to ArcGIS as a Custom Projection which cannot be published as a Point Cloud Scene Layer Package.- Convert Lidar to zlas format and rearrange. - Create LAS Datasets of the lidar tiles.- Colorize Lidar using the Colorize LAS tool in ArcGIS Pro. - Create a new LAS dataset with a division of Eastern half and Western half due to size limitation of 500GB per scene layer package. - Create scene layer packages (.slpk) using Create Cloud Point Scene Layer Package. - Load package to ArcGIS Online using Share Package. - Publish on ArcGIS.com and delete the scene layer package to save storage cost.Additional layers added:Visit https://cteco.uconn.edu/projects/lidar3D/layers.htm for a complete list and links. 3D Buildings and Trees extracted by Esri from the lidarShaded Relief from CTECOImpervious Surface 2012 from CT ECONAIP Imagery 2018 from CTECOContours (2016) from CTECOLidar 2016 Download Link derived from https://www.cteco.uconn.edu/data/download/flight2016/index.htm

Deprecation notice: This tool is deprecated because this functionality is now available with out-of-the-box tools in ArcGIS Pro. The tool author will no longer be making further enhancements or fixing major bugs.Use Add GTFS to a Network Dataset to incorporate transit data into a network dataset so you can perform schedule-aware analyses using the Network Analyst tools in ArcMap.After creating your network dataset, you can use the ArcGIS Network Analyst tools, like Service Area and OD Cost Matrix, to perform transit/pedestrian accessibility analyses, make decisions about where to locate new facilities, find populations underserved by transit or particular types of facilities, or visualize the areas reachable from your business at different times of day. You can also publish services in ArcGIS Server that use your network dataset.The Add GTFS to a Network Dataset tool suite consists of a toolbox to pre-process the GTFS data to prepare it for use in the network dataset and a custom GTFS transit evaluator you must install that helps the network dataset read the GTFS schedules. A user's guide is included to help you set up your network dataset and run analyses.Instructions:Download the tool. It will be a zip file.Unzip the file and put it in a permanent location on your machine where you won't lose it. Do not save the unzipped tool folder on a network drive, the Desktop, or any other special reserved Windows folders (like C:\Program Files) because this could cause problems later.The unzipped file contains an installer, AddGTFStoaNetworkDataset_Installer.exe. Double-click this to run it. The installation should proceed quickly, and it should say "Completed" when finished.Read the User's Guide for instructions on creating and using your network dataset.System requirements:ArcMap 10.1 or higher with a Desktop Standard (ArcEditor) license. (You can still use it if you have a Desktop Basic license, but you will have to find an alternate method for one of the pre-processing tools.) ArcMap 10.6 or higher is recommended because you will be able to construct your network dataset much more easily using a template rather than having to do it manually step by step. This tool does not work in ArcGIS Pro. See the User's Guide for more information.Network Analyst extensionThe necessary permissions to install something on your computer.Data requirements:Street data for the area covered by your transit system, preferably data including pedestrian attributes. If you need help preparing high-quality street data for your network, please review this tutorial.A valid GTFS dataset. If your GTFS dataset has blank values for arrival_time and departure_time in stop_times.txt, you will not be able to run this tool. You can download and use the Interpolate Blank Stop Times tool to estimate blank arrival_time and departure_time values for your dataset if you still want to use it.Help forum

The Intelligent Road Network dataset provided by the Transport Department includes traffic directions, turning restrictions at road junctions, stopping restrictions, on-street parking spaces and other road traffic data for supporting the development of intelligent transport system, fleet management system and car navigation etc. by the public.

Esri China (HK) has prepared this File Geodatabase containing a Network Dataset for the Intelligent Road Network to support Esri GIS users to use the dataset in ArcGIS Pro without going through long configuration steps. Please refer to this guideline to use the Road Network Dataset in ArcGIS Pro for routing analysis. This network dataset has been configured and deployed the following restrictions:

Speed LimitTurnIntersectionTraffic FeaturesPedestrian ZoneTraffic Sign of ProhibitionVehicle RestrictionThe coordinate system of this dataset is Hong Kong 1980 Grid.The objectives of uploading the network dataset to ArcGIS Online platform are to facilitate our Hong Kong ArcGIS users to utilize the data in a spatial ready format and save their data conversion effort.For details about the schema and information about the content and relationship of the data, please refer to the data dictionary provided by Transport Department at https://data.gov.hk/en-data/dataset/hk-td-tis_15-road-network-v2.For details about the data, source format and terms of conditions of usage, please refer to the website of DATA.GOV.HK at https://data.gov.hk.Dataset last updated on: 2021 July

The Habitat Suitability Analysis was built using ArcGIS Pro's ModelBuilder tool. This program does not have an option to save the model's inputs as a relative file path. As a result, the model may not run because it's searching for each layer's original file path. If this happens, we have included a file titled Habitat_Suitability_Analysis_Script that outlines the processes we used to build the model. This submission contains three folders and three supplemental files. The folder titled "Data" includes all of the raw data and data input in the Habitat Suitability Analysis. The folder titled "Scripts" describes the steps to build the Habitat Suitability Analysis model in ArcGIS Pro. The Results folder contains the Habitat Suitability Analysis model and the data that was input into the model. The supplemental files are a file titled "Dryad_Folder_Contents" which describes the contents of every folder in this submission, and a file titled "Habitat_Suitability_Analysis_README" which contain...

This New Zealand Point Cloud Classification Deep Learning Package will classify point clouds into building and background classes. This model is optimized to work with New Zealand aerial LiDAR data.The classification of point cloud datasets to identify Building is useful in applications such as high-quality 3D basemap creation, urban planning, and planning climate change response.Building could have a complex irregular geometrical structure that is hard to capture using traditional means. Deep learning models are highly capable of learning these complex structures and giving superior results.This model is designed to extract Building in both urban and rural area in New Zealand.The Training/Testing/Validation dataset are taken within New Zealand resulting of a high reliability to recognize the pattern of NZ common building architecture.Licensing requirementsArcGIS Desktop - ArcGIS 3D Analyst extension for ArcGIS ProUsing the modelThe model can be used in ArcGIS Pro's Classify Point Cloud Using Trained Model tool. Before using this model, ensure that the supported deep learning frameworks libraries are installed. For more details, check Deep Learning Libraries Installer for ArcGIS.Note: Deep learning is computationally intensive, and a powerful GPU is recommended to process large datasets.The model is trained with classified LiDAR that follows the The model was trained using a training dataset with the full set of points. Therefore, it is important to make the full set of points available to the neural network while predicting - allowing it to better discriminate points of 'class of interest' versus background points. It is recommended to use 'selective/target classification' and 'class preservation' functionalities during prediction to have better control over the classification and scenarios with false positives.The model was trained on airborne lidar datasets and is expected to perform best with similar datasets. Classification of terrestrial point cloud datasets may work but has not been validated. For such cases, this pre-trained model may be fine-tuned to save on cost, time, and compute resources while improving accuracy. Another example where fine-tuning this model can be useful is when the object of interest is tram wires, railway wires, etc. which are geometrically similar to electricity wires. When fine-tuning this model, the target training data characteristics such as class structure, maximum number of points per block and extra attributes should match those of the data originally used for training this model (see Training data section below).OutputThe model will classify the point cloud into the following classes with their meaning as defined by the American Society for Photogrammetry and Remote Sensing (ASPRS) described below: 0 Background 6 BuildingApplicable geographiesThe model is expected to work well in the New Zealand. It's seen to produce favorable results as shown in many regions. However, results can vary for datasets that are statistically dissimilar to training data.Training dataset - Auckland, Christchurch, Kapiti, Wellington Testing dataset - Auckland, WellingtonValidation/Evaluation dataset - Hutt City Dataset City Training Auckland, Christchurch, Kapiti, Wellington Testing Auckland, Wellington Validating HuttModel architectureThis model uses the SemanticQueryNetwork model architecture implemented in ArcGIS Pro.Accuracy metricsThe table below summarizes the accuracy of the predictions on the validation dataset. - Precision Recall F1-score Never Classified 0.984921 0.975853 0.979762 Building 0.951285 0.967563 0.9584Training dataThis model is trained on classified dataset originally provided by Open TopoGraphy with < 1% of manual labelling and correction.Train-Test split percentage {Train: 75~%, Test: 25~%} Chosen this ratio based on the analysis from previous epoch statistics which appears to have a descent improvementThe training data used has the following characteristics: X, Y, and Z linear unitMeter Z range-137.74 m to 410.50 m Number of Returns1 to 5 Intensity16 to 65520 Point spacing0.2 ± 0.1 Scan angle-17 to +17 Maximum points per block8192 Block Size50 Meters Class structure[0, 6]Sample resultsModel to classify a dataset with 23pts/m density Wellington city dataset. The model's performance are directly proportional to the dataset point density and noise exlcuded point clouds.To learn how to use this model, see this story

The ArcGIS Online US Geological Survey (USGS) topographic map collection now contains over 177,000 historical quadrangle maps dating from 1882 to 2006. The USGS Historical Topographic Map Explorer app brings these maps to life through an interface that guides users through the steps for exploring the map collection:Find a location of interest.View the maps.Compare the maps.Download and share the maps or open them in ArcGIS Desktop (ArcGIS Pro or ArcMap) where places will appear in their correct geographic location. Save the maps in an ArcGIS Online web map.

Finding the maps of interest is simple. Users can see a footprint of the map in the map view before they decide to add it to the display, and thumbnails of the maps are shown in pop-ups on the timeline. The timeline also helps users find maps because they can zoom and pan, and maps at select scales can be turned on or off by using the legend boxes to the left of the timeline. Once maps have been added to the display, users can reorder them by dragging them. Users can also download maps as zipped GeoTIFF images. Users can also share the current state of the app through a hyperlink or social media. This ArcWatch article guides you through each of these steps: https://www.esri.com/esri-news/arcwatch/1014/envisioning-the-past.Once signed in, users can create a web map with the current map view and any maps they have selected. The web map will open in ArcGIS Online. The title of the web map will be the same as the top map on the side panel of the app. All historical maps that were selected in the app will appear in the Contents section of the web map with the earliest at the top and the latest at the bottom. Turning the historical maps on and off or setting the transparency on the layers allows users to compare the historical maps over time. Also, the web map can be opened in ArcGIS Desktop (ArcGIS Pro or ArcMap) and used for exploration or data capture.Users can find out more about the USGS topograhic map collection and the app by clicking on the information button at the upper right. This opens a pop-up with information about the maps and app. The pop-up includes a useful link to a USGS web page that provides access to documents with keys explaining the symbols on historic and current USGS topographic maps. The pop-up also has a link to send Esri questions or comments about the map collection or the app.We have shared the updated app on GitHub, so users can download it and configure it to work with their own map collections.

This vector layer provides a detailed shaded relief basemap. The map is designed to be used as a backdrop for topographical, soil, hydro, landcover or other outdoor recreational maps. The layer currently includes hillshade to the largest map scales globally (Greenland coverage to ~1:72K). This hillshade is included in the Outdoor and World Topographic Map (with Contours and Hillshade) tile layers.Use this MapYou can add this layer to a web map and save as your own map. You can also combine this layer's JSON with the JSON of another vector tile layer. This is presented as a multisource tile layer that can be viewed in Map Viewer, or the latest versions of ArcGIS Pro or Runtime.

We implemented automated workflows using Jupyter notebooks for each state. The GIS processing, crucial for merging, extracting, and projecting GeoTIFF data, was performed using ArcPy—a Python package for geographic data analysis, conversion, and management within ArcGIS (Toms, 2015). After generating state-scale LES (large extent spatial) datasets in GeoTIFF format, we utilized the xarray and rioxarray Python packages to convert GeoTIFF to NetCDF. Xarray is a Python package to work with multi-dimensional arrays and rioxarray is rasterio xarray extension. Rasterio is a Python library to read and write GeoTIFF and other raster formats. Xarray facilitated data manipulation and metadata addition in the NetCDF file, while rioxarray was used to save GeoTIFF as NetCDF. These procedures resulted in the creation of three HydroShare resources (HS 3, HS 4 and HS 5) for sharing state-scale LES datasets. Notably, due to licensing constraints with ArcGIS Pro, a commercial GIS software, the Jupyter notebook development was undertaken on a Windows OS.

With either the Oriented Imagery add-in for ArcGIS Pro or the Oriented Imagery widget for ArcGIS Experience Builder, you can access Mapillary’s growing archive of over 2 billion images directly from your ArcGIS Pro project or Experience Builder web app. Once the Mapillary oriented imagery catalog is added to your app or project, you’ll be able to click on a point of interest on your map or scene, then explore all the images of that location in Mapillary’s open database. Learn more about Oriented Imagery. Interested in adding your own imagery to Mapillary’s archive? Learn more about making your images available as open data.

Getting Started:

To add Mapillary imagery to your Experience Builder app:

Create a new Experience Builder app, or edit an existing app. Add the Oriented Imagery widget to your web app. Configure the Oriented Imagery widget: Select the map widget you want to use. Under Choose catalog, select “From item URL” Under “Item URL,” Copy and paste https://mapillary-meta.maps.arcgis.com/home/item.html?id=6a86b887f1cd47d3a97f36ff2b27717d Select Add. Optionally, under “Configure editing” you can make feature layers from your web map or web scene available as overlays in the Oriented Imagery viewer.

Save and preview your app.

In the app, navigate to your area of interest, select the Oriented Imagery widget, and click anywhere highlighted in green to pull up images of that location.

The Topographic (Vector) (World Edition) web map provides a detailed vector basemap for the world symbolized with the classic Esri topographic map style including vector contours and vector hillshade for added context. This map includes highways, major roads, minor roads, railways, water features, cities, parks, landmarks, building footprints, administrative boundaries, and shaded relief for added context. This basemap is available in the United States Vector Basemaps gallery and uses the World Topographic Map (with Contours and Hillshade) multisource vector map style.The vector tile layer in this web map is built using the same data sources used for other Esri Vector Basemaps. For details on data sources contributed by the GIS community, view the map of Community Maps Basemap Contributors. Esri Vector Basemaps are updated monthly.Use this MapThis map is designed to be used as a basemap for overlaying other layers of information or as a stand-alone reference map. You can add layers to this web map and save as your own map. If you like, you can add this web map to a custom basemap gallery for others in your organization to use in creating web maps. If you would like to add this map as a layer in other maps you are creating, you may use the tile layer referenced in this map.

This web map consists of vector tile layers that form a detailed basemap for the world, featuring a neutral style with content adjusted to support environment, landscape, natural resources, hydrologic and physical geography layers. The layers in this map provide unique capabilities for customization, high-resolution display and offline use in mobile devices. They are built using the same data sources used for other Esri basemaps.This web map consists of 4 vector tile layers: A vector tile reference layer for the world with administrative boundaries and labels; populated places with names; ocean names; topographic features; and rail, road, park, school, and hospital labels. A vector tile surface water layer for the world with rivers, lakes, streams, and canals with respective labels. A vector tile watersheds boundaries. A vector tile base layer for the world with vegetation, parks, farming areas, open space, indigenous lands, military bases, bathymetry, large scale contours, elevation values, airports, zoos, golf courses, cemeteries, hospitals, schools, urban areas, and building footprints. Designed by Emily Meriam, this map can be used as a basemap for overlaying other layers of information or as a stand-alone reference map. You can add layers to this web map and save as your own map. Fully display the content of this multisource map using Map Viewer, or current versions of Runtime and ArcGIS Pro. Customize this MapCustomize vector tile layers in this map using the Vector Tile Style Editor to change style, content, symbology, and fonts. Additional details are available in ArcGIS Online Blogs and the Esri Vector Basemaps Reference Document.

This data contains general information about Pedestrian Network in Hong Kong. Pedestrian Network is a set of 3D line features derived from road features and road furniture from Lands Department and Transport Department. A number of attributes are associated with the pedestrian network such as spatially related street names. Besides, the pedestrian network includes information like wheelchair accessibility and obstacles to facilitate the digital inclusion for the needy. Please refer to this video to learn how to use 3D Pedestrian Network Dataset in ArcGIS Pro to facilitate your transportation analysis.The data was provided in the formats of JSON, GML and GDB by Lands Department and downloaded via GEODATA.GOV.HK website.

The original data files were processed and converted into an Esri file geodatabase. Wheelchair accessibility, escalator/lift, staircase walking speed and street gradient were used to create and build a network dataset in order to demonstrate basic functions for pedestrian network and routing analysis in ArcMap and ArcGIS Pro. There are other tables and feature classes in the file geodatabase but they are not included in the network dataset, users have to consider the use of information based on their requirements and make necessary configurations. The coordinate system of this dataset is Hong Kong 1980 Grid.

The objectives of uploading the network dataset to ArcGIS Online platform are to facilitate our Hong Kong ArcGIS users to utilize the data in a spatial ready format and save their data conversion effort.

For details about the schema and information about the content and relationship of the data, please refer to the data dictionary provided by Lands Department at https://geodata.gov.hk/gs/download-datadict/201eaaee-47d6-42d0-ac81-19a430f63952.

For details about the data, source format and terms of conditions of usage, please refer to the website of GEODATA STORE at https://geodata.gov.hk.Dataset last updated on: 2022 Oct

This dataset contains both large (A0) printable maps of the Torres Strait broken into six overlapping regions, based on a clear sky, clear water composite Sentinel 2 composite imagery and the imagery used to create these maps. These maps show satellite imagery of the region, overlaid with reef and island boundaries and names. Not all features are named, just the more prominent features. This also includes a vector map of Ashmore Reef and Boot Reef in Coral Sea as these were used in the same discussions that these maps were developed for. The map of Ashmore Reef includes the atoll platform, reef boundaries and depth polygons for 5 m and 10 m.

This dataset contains all working files used in the development of these maps. This includes all a copy of all the source datasets and all derived satellite image tiles and QGIS files used to create the maps. This includes cloud free Sentinel 2 composite imagery of the Torres Strait region with alpha blended edges to allow the creation of a smooth high resolution basemap of the region.

The base imagery is similar to the older base imagery dataset: Torres Strait clear sky, clear water Landsat 5 satellite composite (NERP TE 13.1 eAtlas, AIMS, source: NASA).

Most of the imagery in the composite imagery from 2017 - 2021.


Method:
The Sentinel 2 basemap was produced by processing imagery from the World_AIMS_Marine-satellite-imagery dataset (01-data/World_AIMS_Marine-satellite-imagery in the data download) for the Torres Strait region. The TrueColour imagery for the scenes covering the mapped area were downloaded. Both the reference 1 imagery (R1) and reference 2 imagery (R2) was copied for processing. R1 imagery contains the lowest noise, most cloud free imagery, while R2 contains the next best set of imagery. Both R1 and R2 are typically composite images from multiple dates.

The R2 images were selectively blended using manually created masks with the R1 images. This was done to get the best combination of both images and typically resulted in a reduction in some of the cloud artefacts in the R1 images. The mask creation and previewing of the blending was performed in Photoshop. The created masks were saved in 01-data/R2-R1-masks. To help with the blending of neighbouring images a feathered alpha channel was added to the imagery. The processing of the merging (using the masks) and the creation of the feathered borders on the images was performed using a Python script (src/local/03-merge-R2-R1-images.py) using the Pillow library and GDAL. The neighbouring image blending mask was created by applying a blurring of the original hard image mask. This allowed neighbouring image tiles to merge together.

The imagery and reference datasets (reef boundaries, EEZ) were loaded into QGIS for the creation of the printable maps.

To optimise the matching of the resulting map slight brightness adjustments were applied to each scene tile to match its neighbours. This was done in the setup of each image in QGIS. This adjustment was imperfect as each tile was made from a different combinations of days (to remove clouds) resulting in each scene having a different tonal gradients across the scene then its neighbours. Additionally Sentinel 2 has slight stripes (at 13 degrees off the vertical) due to the swath of each sensor having a slight sensitivity difference. This effect was uncorrected in this imagery.


Single merged composite GeoTiff:
The image tiles with alpha blended edges work well in QGIS, but not in ArcGIS Pro. To allow this imagery to be used across tools that don't support the alpha blending we merged and flattened the tiles into a single large GeoTiff with no alpha channel. This was done by rendering the map created in QGIS into a single large image. This was done in multiple steps to make the process manageable.

The rendered map was cut into twenty 1 x 1 degree georeferenced PNG images using the Atlas feature of QGIS. This process baked in the alpha blending across neighbouring Sentinel 2 scenes. The PNG images were then merged back into a large GeoTiff image using GDAL (via QGIS), removing the alpha channel. The brightness of the image was adjusted so that the darkest pixels in the image were 1, saving the value 0 for nodata masking and the boundary was clipped, using a polygon boundary, to trim off the outer feathering. The image was then optimised for performance by using internal tiling and adding overviews. A full breakdown of these steps is provided in the README.md in the 'Browse and download all data files' link.

The merged final image is available in export\TS_AIMS_Torres Strait-Sentinel-2_Composite.tif.


Source datasets:
Complete Great Barrier Reef (GBR) Island and Reef Feature boundaries including Torres Strait Version 1b (NESP TWQ 3.13, AIMS, TSRA, GBRMPA), https://eatlas.org.au/data/uuid/d2396b2c-68d4-4f4b-aab0-52f7bc4a81f5

Geoscience Australia (2014b), Seas and Submerged Lands Act 1973 - Australian Maritime Boundaries 2014a - Geodatabase [Dataset]. Canberra, Australia: Author. https://creativecommons.org/licenses/by/4.0/ [license]. Sourced on 12 July 2017, https://dx.doi.org/10.4225/25/5539DFE87D895

Basemap/AU_GA_AMB_2014a/Exclusive_Economic_Zone_AMB2014a_Limit.shp
The original data was obtained from GA (Geoscience Australia, 2014a). The Geodatabase was loaded in ArcMap. The Exclusive_Economic_Zone_AMB2014a_Limit layer was loaded and exported as a shapefile. Since this file was small no clipping was applied to the data.

Geoscience Australia (2014a), Treaties - Australian Maritime Boundaries (AMB) 2014a [Dataset]. Canberra, Australia: Author. https://creativecommons.org/licenses/by/4.0/ [license]. Sourced on 12 July 2017, http://dx.doi.org/10.4225/25/5539E01878302
Basemap/AU_GA_Treaties-AMB_2014a/Papua_New_Guinea_TSPZ_AMB2014a_Limit.shp
The original data was obtained from GA (Geoscience Australia, 2014b). The Geodatabase was loaded in ArcMap. The Papua_New_Guinea_TSPZ_AMB2014a_Limit layer was loaded and exported as a shapefile. Since this file was small no clipping was applied to the data.

AIMS Coral Sea Features (2022) - DRAFT
This is a draft version of this dataset. The region for Ashmore and Boot reef was checked. The attributes in these datasets haven't been cleaned up. Note these files should not be considered finalised and are only suitable for maps around Ashmore Reef. Please source an updated version of this dataset for any other purpose.
CS_AIMS_Coral-Sea-Features/CS_Names/Names.shp
CS_AIMS_Coral-Sea-Features/CS_Platform_adj/CS_Platform.shp
CS_AIMS_Coral-Sea-Features/CS_Reef_Boundaries_adj/CS_Reef_Boundaries.shp
CS_AIMS_Coral-Sea-Features/CS_Depth/CS_AIMS_Coral-Sea-Features_Img_S2_R1_Depth5m_Coral-Sea.shp
CS_AIMS_Coral-Sea-Features/CS_Depth/CS_AIMS_Coral-Sea-Features_Img_S2_R1_Depth10m_Coral-Sea.shp

Murray Island 20 Sept 2011 15cm SISP aerial imagery, Queensland Spatial Imagery Services Program, Department of Resources, Queensland
This is the high resolution imagery used to create the map of Mer.

World_AIMS_Marine-satellite-imagery
The base image composites used in this dataset were based on an early version of Lawrey, E., Hammerton, M. (2024). Marine satellite imagery test collections (AIMS) [Data set]. eAtlas. https://doi.org/10.26274/zq26-a956. A snapshot of the code at the time this dataset was developed is made available in the 01-data/World_AIMS_Marine-satellite-imagery folder of the download of this dataset.


Data Location:
This dataset is filed in the eAtlas enduring data repository at: data\custodian\2020-2029-AIMS\TS_AIMS_Torres-Strait-Sentinel-2-regional-maps. On the eAtlas server it is stored at eAtlas GeoServer\data\2020-2029-AIMS.


Change Log:
2025-05-12: Eric Lawrey
Added Torres-Strait-Region-Map-Masig-Ugar-Erub-45k-A0 and Torres-Strait-Eastern-Region-Map-Landscape-A0. These maps have a brighten satellite imagery to allow easier reading of writing on the maps. They also include markers for geo-referencing the maps for digitisation.

2025-02-04: Eric Lawrey
Fixed up the reference to the World_AIMS_Marine-satellite-imagery dataset, clarifying where the source that was used in this dataset. Added ORCID and RORs to the record.

2023-11-22: Eric Lawrey
Added the data and maps for close up of Mer.
- 01-data/TS_DNRM_Mer-aerial-imagery/
- preview/Torres-Strait-Mer-Map-Landscape-A0.jpeg
- exports/Torres-Strait-Mer-Map-Landscape-A0.pdf
Updated 02-Torres-Strait-regional-maps.qgz to include the layout for the new map.

2023-03-02: Eric Lawrey
Created a merged version of the satellite imagery, with no alpha blending so that it can be used in ArcGIS Pro. It is now a single large GeoTiff image. The Google Earth Engine source code for the World_AIMS_Marine-satellite-imagery was included to improve the reproducibility and provenance of the dataset, along with a calculation of the distribution of image dates that went into the final composite image. A WMS service for the imagery was also setup and linked to from the metadata. A cross reference to the older Torres Strait clear sky clear water Landsat composite imagery was also added to the record.

This vector tile layer provides a detailed global contour set with labels. Contours are in meters (for most of the world) and feet (for the 48 contiguous US states plus Hawaii). They are visible from LOD11 (~1:144K) to the largest scale. These contours are used in the Outdoor and World Topographic Map (with Contours and Hillshade) tile layers.Use this MapYou can add this layer to a web map and save as your own map. You can also combine this layer's JSON with the JSON of another vector tile layer. This is presented as a multisource tile layer that can be viewed in Map Viewer, or the latest versions of ArcGIS Pro or Runtime.Customize this MapCustomize this map using the Vector Tile Style Editor to change layer style, content, symbology, and fonts. Additional details are available in ArcGIS Online Blogs and the Esri Vector Basemaps Reference Document.

We implemented automated workflows using Jupyter notebooks for each state. The GIS processing, crucial for merging, extracting, and projecting GeoTIFF data, was performed using ArcPy—a Python package for geographic data analysis, conversion, and management within ArcGIS (Toms, 2015). After generating state-scale LES datasets in GeoTIFF format, we utilized the xarray and rioxarray Python packages to convert GeoTIFF to NetCDF. Xarray is a Python package to work with multi-dimensional arrays and rioxarray is rasterio xarray extension. Rasterio is a Python library to read and write GeoTIFF and other raster formats. Xarray facilitated data manipulation and metadata addition in the NetCDF file, while rioxarray was used to save GeoTIFF as NetCDF. These procedures resulted in the creation of three composite HydroShare resources (HS 2, HS 3 and HS 4) for sharing state-scale LES datasets. Notably, due to licensing constraints with ArcGIS Pro, a commercial GIS software, the Jupyter notebook development was undertaken on a Windows OS.

Repository for all code and data used in Compare and Ye, "Using process-based understanding and feature selection to inform a LSTM neural network model for simulating stage of an eogenetic karst spring".

This repository contains folders for Code, Data, Plots, Models, Results and Additional Figures.

Some raw data was collected manually form the Northwest Florida Water Management District online portal (https://nwfwmd.aquaticinformatics.net/) and the Florida Climate Center (https://climatecenter.fsu.edu/climate-data-access-tools/downloadable-data), and this has been noted in the code when appropriate. USGS data of Wakulla Spring was downloaded within the notebook. Both raw and processed data can be found in the data folder.

Code is organized in 4 Juptyer Notebooks

1. Data processing
2. Hyperparameter tuning for each of the neural networks
3. Training the neural networks under the tuned parameters and saving the network weights and simulation results
4. Generating figures used in the reports (Due to the computational demands of hyperparameter tuning, it is recommended to not run this code again unless you have a good amount of storage and time.)

Model weights for each of the models are saved in the Models folder from Notebook 3, and loaded from here in Notebook 4.

Plots generated with code are saved in the Plots folder from Notebook 4.

Some additional figures for this study were generated in ArcGIS Pro and Adobe Illustrator, and these files can be found in the AdditionalFigures folder.

This is a clone of the GitHub repo found at https://github.com/kylecompare/FeatureSelection-KarstSpringLSTM from February 7, 2024.