Professional Documents
Culture Documents
Paper QC QA in GIS 2018 16pages
Paper QC QA in GIS 2018 16pages
net/publication/339297817
CITATIONS READS
0 1,840
1 author:
Zakaria Ahmed
Thebes Academy
8 PUBLICATIONS 7 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Zakaria Ahmed on 14 September 2020.
1 Abstract
This paper presents a focus on Quality Control and Quality Assurance in GIS.The heart of
any spatial system is its powerful and reliable GIS database. This is of great importance in all
geographic information systems projects including Hajj, Umrah, tourism, real estate, and natural
resources. Since the spatial database is inherently complex and requires special technical skills to
maintain, the applications also require special technical skills. The inconsistencies in the database
can be minimized by adopting best practices to maintain the database. The systematic approach
to updating the large spatial database has been described here. Quality procedures have been
discussed. Several preventive mechanisms have been adopted. Various qualitative aspects of the
spatial database such as consistency, completeness, integration, etc. were analyzed and their
interrelationships analyzed. The emphasis is on achieving customer-oriented quality in a spatial
database.
With the general definition of quality, "the degree to which project deliverables meet
requirements", the challenge for GIS projects is to properly define specifications and specific quality
parameters that are appropriate for different types of GIS projects and deliverables. There is a big
demand for digital maps and GIS applications in Egypt. The production process in Egypt employs
manual techniques that are lengthy operational, time consuming and costly, it needs Quality control
and quality assurance procedures. We applied them in ten geological maps of Egypt with scale
1:500,000. It is a project as a cooperation between Cairo university and Ministry of Water
Resources and Irrigation of Egypt. As a training for the students of the faculty of engineering, civil
department.
(Key Words: Quality, Spatial Data, Data acceptance Criteria, Automated Quality Control, Quality
Control, Quality Assurance)
2 Introduction:
With the general definition of quality, "the degree to which project deliverables meet requirements",
the challenge for GIS projects is to properly define specifications and specific quality parameters
that are appropriate for different types of GIS projects and deliverables. In GIS projects, quality can
be defined (and ideally measured and assessed) for specific deliverables such as:
• reports and documents (needs assessment, design documents, plans, etc.);
• conceptual and physical database designs;
• spatial data collected from aerial surveys or satellite images and processed for delivery
to users
• GIS data compiled from field data collection, map digitizing, or other means; and
• GIS applications (custom-designed user interface and functionality from GIS software).
1
project deliverables establish the basis for quality management. Quality criteria associated with
different types of GIS project deliverables is identifies as:
In GIS projects, there is considerable focus on quality management for GIS data and custom
application development.
In major GIS database development projects, like the one being launched by the City of
Metropolis, it is common practice to prepare an initial database design and set up database
development procedures (including QC steps) and then initiate a pilot project--a task or sub-project
that is part of the overall database development project. The purpose of the pilot is to test the
design, source material management, data capture and development procedures, QC approach,
etc., and then to use the pilot project results to refine the design and procedures before initiating
production work. In GIS database work, the concept of incremental data improvement is important.
Consider a major GIS database project for a water utility organization which has the objective of
developing a complete GIS database of
2
4 GIS software provides tools for customizing applications that meet the needs of users.
The types of customization work that often come up in GIS projects include:
• automating access, integration with other systems or databases, or import/export of files
with external databases and applications;
• designing and developing “intelligent” interactive forms for attribute or graphic data entry
(includes use of dropdown pick lists, automatic error checking, and other controls);
• developing application scripts that can be launched by a simple menu pick and combining a
number of individual functions;
• designing and creating templates for standard maps and textual reports;
• creating data quality control and quality assurance applications using validation tools
provided by the software package;
• creating a library of standard queries that can be accessed through a menu;
• programming complex analysis functions using basic GIS processing commands; and
• building custom geospatial statistics or analysis models (e.g., network analysis).
The types of quality issues that are important in planning and execution for software and GIS
application development projects are:
• proper functionality;
• usability and adherence to user interface standards;
• efficiency, performance, response time;
• adherence to coding, programming standards;
• flexibility and maintainability;
• proper access to GIS data sources; and
• completeness and clarity of documentation.
Software and application development work can follow a number of formal methodologies, the key
point is that a formal, organized methodology should be put in place and followed during project
execution. As a matter of quality management, key steps in the process (user application needs
assessment, design, prototyping, operational deployment, documentation) should have defined
steps for user review and comment which is used by the development team to incrementally refine
the applications in a process that culminates in deployed applications that meet stated
requirements.
To achieve this, we must lose the process properly and continue to inspect the product from time
to time.
Appropriate measures should be taken if any deviation is observed after such checks.
In this way, opportunities for producing a flawless product can be improved and access to
performance increases
"True from the first time"
4
The principles on which quality is based
The dimensions of quality passed through several stages during the last century can be
illustrated by:
8 Quality Dimensions:
There are a range of characteristics or qualities that characterize quality in order to be able to
satisfy the needs and desires of users and the identification of these characteristics is an important
process for management that seeks to achieve quality in its products and services.
There are different opinions about the number of these characteristics or characteristics by
researchers, that Garvin's point of view will be addressed in order to determine the dimensions of
quality identified by eight elements:
• Performance: These are the characteristics of the initial operation of the product, ie, the
performance of the specific function.
• Feature: Is the set of accessories available with the primary product.
5
• Reliability: The ability of the product to continue its function without interruption or the need
for substantial maintenance
• Conformance: Is the degree to which the product conforms to established standards.
• Durability: The number of years represents the expected service of the product before it
deteriorates.
• Maintenance Serviceability: It refers to the ease, speed and low cost of repairing the
product.
• Aesthetics: Refer to the product body and external problem.
• Perceived Quality: It refers to the product's reputation, the trust of users and the
organization.
9 Quality Management:
PMBOK has defined quality management as "all activities undertaken by the organization to define
the policies, objectives and responsibilities that the organization must perform in order to satisfy
the needs of which it operates.”
10 Quality costs
First: Quality Cost Concept
The costs are borne because of the low quality that can exist because of the poor quality.
And is carried to ensure that the quality standards established or because of their inability to
meet them are met and that the cost of quality is defined as the costs incurred to prevent or the
costs incurred as a result of the production of low quality products and the costs arising with the
quality of the defect relating to diagnosis, repair and prevention of damage. Quality Cost Types:
Quality costs are classified into four types:
Prevention costs , Appraisal Costs, Internal failure costs, and External failure costs
Quality costs = prevention costs + calendar costs + internal and external failure costs
Traditional Perspective
6
The quality level of the products is determined according to the traditional perspective by balancing
the costs incurred for the prevention and evaluation
activities on the one hand and the cost of the failure
activities in conforming to the specifications on the
other. Figure (2) shows the point of separation as a
percentage of the defective units. Total cost costs
constitute the total expenditure for prevention, Internal
and external. The optimal level of product quality is the
point at which total costs are minimized
Contemporary Perspective
The quality of the products is achieved at the level
of zero defect where the internal and external failure
costs increase with the increase in the proportion of
defective products, while the costs of prevention and
evaluation is slightly increased at the beginning but
soon begins to decline with the increase in the
proportion of defective products, and therefore the
minimum cost of quality Checks at the zero defective
level
7
anything without specific, reliable, accurate geographic data. GIS technology requires clean data.
Looking at this angle the tools used for the updating and maintaining the database must be latest
and most efficient.
8
Visual inspection of GIS data is reinforced by automated QA methods. GIS databases can
be automatically checked for adherence to database design, attribute accuracy, logical
consistency, and referential integrity.
12.1 METHODOLOGY
The quality assurance procedures methodology for the converted data follows.
12.2 AUTOMATED QUALITY ASSURANCE
The Quality Assurance Supervisor will run each program on each delivery of converted data. Each
automated step in the quality assurance procedures for converted data is described below.
Since the data being checked by these programs is programmatically generated, this check is run
on 100 percent of the data and, in general, must be 99 percent correct for acceptance, although
9
specific error limits may be defined in contractor specifications. Acceptability will be based on the
number of errors reported divided by the number of attributes checked.
The types of automated checks used will vary from project to project, but the database quality
criteria that lend themselves to automated checks include:
Graphic Quality Attribute Completeness/Rule Base Adherence
Attribute Accuracy Symbology, Annotation, and Sheet Format
Photogrammetric Data Quality and Integrity.
12.3 MANUAL QUALITY ASSURANCE CHECKS
Some QA checks cannot easily be automated and require manual checks, usually based on a
sound random sampling approach, although for some criteria, 100 percent checks may be possible.
Quality criteria that are most suited to manual checks include those below. While these checks are
manual in nature requiring operator inspection, they are aided by automated tools to facilitate
access and viewing of automated files and the recording of error notes by QA technicians. In some
cases, manual checking will require the comparison of data to source material using generated
checkplots from the digital data.
File and Layer Naming
Map Feature Completeness and Organization
Positional Accuracy
Symbology, Annotation, and Sheet Format
Image Format and Quality
Photogrammetric Data Quality and Integrity.
Some important details about the manual QA checking process are described below.
12.3.1 Overall Cursory Scan
This general visual scan will be an attempt to identify any missing or incorrectly placed data. This
check will be conducted at the beginning of the random sampling inspection. The QA/QC
Technicians will look over the converted data related to the facility source map currently being
inspected, comparing the converted data to the source maps to verify that all features are captured
and spatially correct.
12.3.2 Random Selection
The QA Supervisor will run the random sampling selection program to generate a report consisting
of a random sample of converted objects based on the total number of populated record attributes
per grid area. The acceptance criteria (allowable errors) are also listed on the report based on the
sample size for each design file.
12.3.3 Missing or Omitted Data
At any time during the inspection process, the QA Technicians will be looking for missing or omitted
data. Missing graphic data identified during the Cursory Inspection will be cause for immediate
failure.
12.3.4 Disposition of Inspected Data
Completion of QA for a data set will be based on standard delineation. QA will be considered
complete based on the full inspection of a standard subset area. Once all tiles in a subset are
accepted, the area will be recorded as “QA Accepted,” and no updates or corrections will be
performed in that area prior to delivery to the client.
12.4 REPORTING
Reporting of errors identified by the QA Technicians will be documented by several means. A brief
description of all errors will be recorded on the QA review report.
10
13.1. Starting a Quality Assurance Program
How to initiate a QA/QC program (planning stages)
Acknowledge the workflows where the GIS data is used so that data expectation is better
known , Establish criteria on which data can be accepted, as an establish data standards
(ESRI data models can be used). Create QC tasks to compare input data to the established
data standards
Find and record errors
• Check for feature completeness
Missing features geometry - incomplete features geometry
11
Spatial data location checks can include:
• Projection - Coordinate System & datum - X/Y/Z Domain extent
Create initial checklist on data
• Compare the count of the features from the source and the destination (when checking on
data modification tasks or data migration tasks)
• Confirm that unique values field is indeed using no actual or logical duplication (can use
'Frequency Count' tool)
• Check for badly formed geometry (can use the 'Check Geometry' tool)
• Search for sliver polygons, which are very thin polygons surrounding parts of bigger
polygons
• A QA grid should be slightly larger than the full extent of the inspected area
• The grid can be non-uniform (can borrow a zoning feature class to track progress using its
polygons)
• Can contain a property to track the visual inspection status (not started – in progress –
completed)
Using the overview and magnifier windows
• Help in keeping the inspector focused on the data without zooming in and out frequently
• Using the magnifier can limit the checking at a specific precision level
• Outlines the procedures used to measure input data quality against the data criteria
12
QA Plans and GIS Projects
Each GIS project should have its custom-tailored QA plan to specify its input and output
QA Plan Contents
Project management section - Project design section - Project data assessment section - Project
reporting and oversight section
Pilot Project
A pilot project is a required step in the process of creating a QA plan, its main purpose is to check
the applicability of the constrains and checks done in the QC process
15 QA/QC Checklist
Twelve main categories
• Documentation and File Structure • Network Checklist
All pertinent documents Connectivity
- Contain a brief description of the project Loops
▪ What client requested Direction of Flow
▪ How it was completed - Sources or sinks
- Original abstract Rules in place and working
▪ Outline of steps taken Document
- Metadata
- Standardized file structure
- Any other documentation
▪ Spatial references
▪ Specific output types
▪ Any paper documents used
• Project Checklist • Relationship Checklist
Relevant Name Relationships to Other Datasets
Opening the Project - One to one
- Open with no errors - One to many
- Desired location - Database connections
▪ Extent of system Document
▪ Specific location
- Correct drawing order
- Layer States or definition queries
- Symbols
Does the GIS do what it is supposed to do?
• Data Checklist • Annotation Checklist
Relevant Data Visible
Correctly Named - When and where it should be
- Naming Conventions Relative
Proper Location Dynamic or stored in a database
- i.e. C:\AMFM\ABC_Cooperative Multiple copies
Pre-Defined Model Document
- Other billing or staking programs
• Data Structure Checklist • Custom Applications Checklist
Data in Correct Layer Do they load?
- All fuses in fuse layer Do they work on the clients hardware?
- All transformers in transformer layer - Plot Routines
- Etc…
Viewable when it should be
Document
• Attributes Checklist • Wall Map/Map Book Checklist
Actual Data Common Output Formats
Symbolize from an attribute Only contact with GIS for some
• Is that field value complete? - Base opinion of what they think
– Subtype or block - Education
reference? Page Numbering
Label from an attribute - Correct Order
Document Scale
Symbols
- Size
- Color
Effective use of the page
Is annotation visible?
• Data Conversion Checklist • Project Checklist for Clients
Converted or imported to GIS from another platform - Point of Delivery
Check for lost data - Correct File Path
One to one match - All Layers Available
13
Proper Conversion - Correct View
- Polygon to polygon - Correct Features On or Off
- Point to point - Printers and Other Hardware Configured
- Polyline to polyline - QA/QC Checklist for Client
- Same relative location Document
16 Study Project:
Ten hardcopy geology maps of a scale of 1:500,000 in Egypt, produced by the Egyptian Survey Authority
(ESA) and the Military Survey Department (MSD) are used. The base maps are scanned with resolutions of
400 dpi, transformed to raster format, and then rectified with projection adjustment. The project staff of 10
persons converted the maps to vector format with geographic types. Some errors are founded after making
QC procedure as in the following table:
Ten images: Vector for 10 images: Some shifts:
18 RECOMMENDATIONS
The following recommendations are the most comprehensive recommendations that are suggested
for future research:
1. The quality activities in the company are attributed to a group of departments and activities.
No one is responsible for all quality activities, and the non-adoption of methods of measuring
and managing the costs of quality and consequently its impact on the company's resources
as a result of not measuring these costs and monitoring them.
2. The concentration of management and employees on quality assessment, through the
examination and try to find a lack of conformity with the specifications
3. We have to make QA and QC procedures and checklist in any GIS project and
Geodatabase.
4. Any GIS project should have a part from the total budget of the project.
15
LIST OF REFERENCES
1. American National Standard , ASOC Z.1.4 Standard ,
https://portal.katespadeconnect.com/documents/10113/23796547/ASOC+Z1.4-
1993
2. Gary J Hunter ,”Issues and prospects for Spatial data quality”
spatial information technology ICORG vol -1
40-45,BSP publications.
11. Sherry Smith & Jay Cary, Developing a Quality Assurance Plan,ESRI,
September 15, 2010
16