A Power Inspector Detection System Based on BeiDou GNSS and Augmented Reality Technology
Wei Zhang1,*
Jinyong Ou1
Kaifeng Deng1
-
Intelligent Operation Center of Guizhou Power Grid Co., Ltd., No.5 Baba Street, Guiyang
550000, China
Copyright © 2026 The Institute of Electronics and Information Engineers
Keywords
Beidou GNSS positioning technology, Power operation monitoring, Intelligent positioning system, Operator tracking
1. Introduction
With the increasing degree of social informatization and the rapid development of
the national economy, the demand for electricity in various industries and fields
in China is getting bigger and bigger, and China is gradually becoming the largest
country in the world in terms of electricity consumption and power generation, and
it also has the largest power grid in the world. The development of the national economy
is heavily reliant on the construction and stable operation of the power grid, as
electricity serves as the pivotal driving force for both economic and industrial growth.
Ensuring the uninterrupted functioning of the power system is crucial for safeguarding
social production and daily life [1]. In recent years, China’s transmission line construction continues to advance, according
to the State Grid and the Southern Power Grid, in 2022 the State Grid cumulative construction
of 110 (66) kV and above transmission line length of about 1.24 million km, the Southern
Power Grid cumulative construction of the end of 2022 110 (66) kV and above transmission
line length of about 258,000 km [2]. The steady progress in the scale of transmission line construction provides a clear
demand for the construction and development of smart grids.
Fig. 1. Manual inspection.
In China, the most dominant transmission methods are ultra-high voltage (UHV) and
extra-high voltage (UHV) long-distance [3]. The advantage of this transmission method is that the use of large-scale overhead
transmission lines can greatly enhance the effective transmission capacity of the
power system, which can well protect the growing demand for electricity. However,
China’s power energy and power demand are distributed in the reverse direction, which
leads to huge transmission lines across a variety of complex terrain, such as: swamps,
lakes, basins, hills and other extreme terrain, in addition to the power equipment
also need to withstand extreme weather, such as thunder and lightning, gusty winds,
blizzards, ice and other harsh natural environments [4]. The above factors will accelerate the aging, wear and corrosion of ultra-high voltage
and extra-high voltage transmission lines and supporting power supply equipment to
varying degrees, thus greatly increasing the possibility of grid outages. How to guarantee
that this huge power equipment’s are always in good working condition is a great challenge.
At present, the maintenance of the power system mainly relies on the timed manual
inspection of the power shift. In manual inspection, inspectors will carry detection
equipment and climb to the power line tower. The inspectors will complete a close
inspection of wire clips, insulators, transmission lines and the power equipment on
them on the power line pole tower, as shown in Fig. 1.
After years of development, in order to protect the safety of users of electricity
and the safety of power operators, the national grid has developed relevant safety
rules and regulations, which clearly defines the division of responsibilities for
electric power safety supervision within the National Energy Administration and its
dispatching agencies, clarifies the safety responsibilities of electric power enterprises,
and stipulates that electric power enterprises should keep records and report documents,
information, drawings, audio-visual recordings and related to electric power production
data. The current management system pertaining to the fundamental operational shifts
within the power grid remains inadequate, notably lacking a comprehensive post-assessment
framework in both its administration and execution. There exists a void in terms of
real-time, effective monitoring and command capabilities, leading to ambiguity in
assigning responsibility for safety production. Given the heightened emphasis on safety
in the contemporary era, its significance has ascended to the forefront of all operational
priorities. Consequently, enhancing and fortifying the safety standards of operational
shifts has emerged as a pivotal challenge that power grid enterprises must urgently
address.
In terms of manual inspection, due to the need for manual inspection of power towers
in close proximity, in order to protect the safety of personnel and standardize the
production process, there is an increasing demand for the location of personnel as
well as video monitoring in power inspection operations. This demand raises the requirements
for mobile intelligent terminals carried by operators, which require mobile terminals
to integrate multiple functions including navigation, voice calls, video interactions,
etc.
For the staff location and video monitoring needs in manual power inspection, this
paper designs a power inspection supervision system based on BeiDou differential positioning
and real view enhancement system, and combines an electric field shielding high-precision
wearable intelligent positioning device to realize sub-meter operation staff location
based on BeiDou RTK technology, and embedded voice operating system and AR video assisted
interaction system to realize Human-computer interaction. In addition, the application
of intelligent terminal and whole process management system in monitoring and commanding
realizes whole process management, realizes real-time monitoring and assistance to
inspectors, and improves the efficiency of inspection operation while safeguarding
the safety of personnel.
2. Related Theories and Technologies
2.1. Whole Process Management
Whole process management is a management process for products or services to be managed
from the beginning to the end of their life cycle, and according to the management
process, a recordable, closed-loop, traceable and sustainable improvement management
procedure and system is formed. As one of the methods of management science, the whole
process management overlooks the life cycle of the project from the management process
[5,
6]. It usually takes time and key nodes as the process reference system, divides each
stage, embeds the management of project schedule, quality, capital and other elements
into each stage, sets goals and plans respectively in each stage, and grasps the components
of the system and the interconnection and interaction of each subsystem, so as to
comprehensively manage the overall goal, plan and performance of the project, and
finally provide effective management methods for the project to achieve the overall
goal and performance.
2.2. BeiDou Differential GNSS Technology Positioning
BeiDou differential GNSS technology is a widely used and effective method to reduce
or even eliminate various measurement errors, which is based on the differential positioning
method, so its accuracy is significantly higher than the single-point positioning
accuracy. The positioning system based on BeiDou differential GNSS technology can
realize positioning accuracy within 1m in both horizontal and vertical directions.
At present, there are several governmental and commercial differential GNSS systems
in the research and development stage or already in operation.
The positioning principle of BeiDou differential GNSS is mainly based on the spatial
and temporal correlation of satellite clock error, satellite ephemeris error, ionospheric
delay and tropospheric delay [7,
8]. For different satellite signal receivers in the same region, the four error components
contained in their received signals are approximately equal or highly correlated.
In BeiDou differential GNSS, the differential correction quantity is mainly used,
which takes one of the receivers as a reference, i.e., the location of this receiver
is the base station, and this receiver is the base station receiver. The location
of the base station receiver is pinpointed so that the true distance from the satellite
to the base station receiver can be accurately calculated. Comparing the base station
receiver’s observations of the satellite with the true geometric distance on this
basis, the measurement error of the base station receiver for this satellite can be
quantitatively described. Based on this principle, the errors in the distance measurements
of other satellite receivers located in the same geographic area to the same satellite
at the same moment can be accurately represented as shown in the Fig. 2. By receiving the measurement error sent by the base station, the BeiDou GNSS user
can calibrate the distance measurement value of the same satellite, and the measurement
and positioning accuracy of the user receiver can be improved by this method. This
positioning method mainly depends on the baseline length between the user’s satellite
receiver and the base station receiver, and when the propagation paths of the satellite
signals arriving at the two receivers are more similar, the correlation of the measurement
errors of the two receivers is stronger, and the positioning effect of the differential
system is more excellent.
Fig. 2. Principle of Beidou GNSS positioning technology.
2.3. AR Technology
Augmented reality technology is developed on the basis of virtual reality technology,
and has received widespread attention immediately after it was proposed. The core
problem of AR system is how to realize the seamless integration of virtual information
and real environment [9]. Currently there are two mainstream methods to realize AR technology, the first is
optical technology and the other is video technology. The basic principle of optical
technology is to use semi-transparent or semi-reflective lenses to realize the fusion
of the two, AR system will be computer-generated virtual information after registration
is displayed on the semi-transparent lens, the user through the virtual information
seen from the lens and the real environment seen through the lens superimposed, thus
completing the augmented reality of all the information displayed. The principle of
video technology is that the camera constantly collects images of the real environment,
and after the images are processed and three-dimensionally registered, then the computer
superimposes the virtual information into the collected images of the real environment.
2.4. Intelligent Terminal
Inteclient terminal is a kind of embedded computer equipment, and its architecture
framework includes hardware layer, middle layer, system software layer and application
software layer [10]. As an application direction of embedded system, intelligent terminal has a clear
application scenario, so its system structure is clearer, the granularity is finer,
and it requires specific functions, stronger reliability, lower cost, lower power
consumption and smaller size to be convenient to carry. In addition, according to
the specific application scenario, it also needs to have the characteristics of moisture
resistance, cold resistance, high temperature resistance and fall resistance [11].
The software of the intelligent terminal is divided into system software and application
software, among which the operating system is the core [12]. Middleware provides independence, and applications directly meet user needs [13]. In certain architectural designs, applications have the capability to interface
directly with the underlying services. A prime example of this is the Android intelligent
terminal software platform, which is predominantly governed by Google and operates
on a Linux-based system level. Within the middleware tier, it is meticulously structured
into two distinct layers: the lower layer encompasses the functional library and the
Dalvik virtual machine, whereas the upper layer comprises the application framework,
offering a robust and versatile foundation for software development [14]. Through this framework, the services published by one application can be used by
other applications. Fig. 3 shows the architecture diagram of the intelligent terminal power operation monitoring
system.
Fig. 3. Architecture diagram of intelligent terminal power operation monitoring system.
Intelligent terminal processor is one of the core components of intelligent terminal,
and its function and efficiency have a great impact on the performance of the whole
system. The processor also has certain requirements.
With the rapid development of intelligent terminals, the application scenarios require
the intelligent terminal processor to quickly process the requests submitted by users,
present the results, and finally provide users with a better experience [15]. Smart terminals require highly integrated processors to integrate all necessary
equipment within a limited size, ensuring the portability of the terminals. [16]. Low power consumption. Application scenarios require smart terminals to have long
running time and standby time, so processors are required to have low power consumption.
There is a subtle connection between high integration, high performance and power
consumption. High integration and high performance often complement each other, while
high performance is often accompanied by higher power consumption. The task of the
designer is to find a balance between the three to meet the needs of specific application
scenarios and optimize the design.
2.5. Web GIS
Web GIS (Network Geographic Information System) refers to a geographic information
system working on the web [17,
18]. It is the extension and development of traditional geographic information system
on the network. It has the characteristics of traditional geographic information system
and is also the basis of publishing, sharing, communicating and cooperating geographic
information on the Internet. Compared with the traditional GIS, Web GIS has more applicable
characteristics by applying GIS to web network. Web GIS can integrate with other information
services seamlessly, and establish flexible GIS applications. It uses HTML general
browser and has cross-platform characteristics.
The evolution of Web GIS is intimately intertwined with advancements in GIS technology,
information technology, and communication technology. Numerous Internet networking
innovations can be seamlessly integrated into Web GIS systems, facilitating their
growth. Nevertheless, Web GIS continues to confront pivotal technological challenges
that necessitate resolution, including the development of high-quality data compression
techniques, the implementation of broadband-compatible and high-bitrate WAP technology,
and the design of modular GIS components. As broadband networks gain widespread adoption
and WAP technology surges ahead, the application scope of Web GIS is poised to expand
exponentially, offering a broader range of capabilities and services. Fig. 4 shows detailed diagram of electric power operation monitoring process.
Fig. 4. Detailed diagram of electric power operation monitoring process.
2.6. Cloud Video
Cloud video organically combines ultra-large-scale distributed storage, intelligent
distributed parallel processing technology, dynamic real-time distributed transcoding
technology, intelligent terminal rate-adapted video transmission technology, automatic
adaptation and adjustment of code stream, user’s nearby service selection, and server’s
automatic provision of the best data stream service according to terminal type, forming
a highly intelligent cloud video network service group [19]. Cloud video has the advantages of resource sharing, business collaboration, intelligence
and reliability, and can provide reliable services for users. Applying cloud video
to remote video surveillance makes up for the defect that local surveillance can only
realize local security function, and maximizes the value of video surveillance.
3. Demand Analysis of Electric Power Operation Monitoring and Command System
3.1. The Current Situation of Electric power Inspection and the Existing Problems
Through on-the-spot investigation of power operation in a power grid company and in-depth
communication with relevant personnel, we have fully grasped the whole process of
power operation. Electric power operation can be divided into three types: planned
operation, unplanned operation and patrol inspection operation [20]. Among them, the planned operation is the power operation that has been included
in the plan a few days ago
This operation requires the operator to fill in the relevant documents one day before
the operation execution and hand them over to the supervisor, who will check the documents
and fill in the planned operation working ticket. The next day, the operator will
receive the planned working ticket for execution, and the supervisor will check the
planned operation documents and manage the operation progress. Unplanned operation
is set up in response to unexpected situations, mainly including circuit lines and
equipment damage caused by rainstorm, vehicle collision with power equipment in traffic
accidents, etc [21]. For different damage reasons and degrees, operators need to perform corresponding
operations to restore the normal operation of power equipment, and fill in relevant
unplanned operation tickets, so the execution frequency of this operation is low.
The purpose of patrol inspection is to master the running status of equipment and
the changes of surrounding environment, find out the defects of facilities and hidden
dangers endangering safety, and take effective measures in time to ensure the safety
of equipment and system stability. This operation is generally carried out irregularly
according to the running status of power equipment. Compared with the unplanned operation,
the content format of the inspection operation record is relatively unified, and only
the operation of each tower on the inspected line and the existence of foreign bodies
needs to be recorded. Data correlation formula and linear regression model formula
are shown in Eqs. (1) and (2).
In the process of power operation execution and management, the personnel involved
mainly include operation construction personnel (referred to as operation personnel)
and supervisors [22]. Each day, prior to departing, the operator submits the scheduled operational plan
for the following day to the supervisor and subsequently collects the approved paper
operation ticket the next morning. Additionally, they gather necessary equipment for
the operation along with an extensive array of circuit diagrams, geographical information
maps, and a comprehensive atlas of text-heavy risk mitigation measures from the operation
tool management office, thereafter embarking on their journey to each designated operational
site. When starting the operation of the day, it is necessary to consult the circuit
equipment drawings, geographic information maps, risk measures atlas and other materials,
fill in the details of the operation, and execute the operation. When an emergency
occurs, the operator communicates with the supervisor through walkie-talkie, fills
in the unplanned operation ticket, and then executes the operation. When the supervisor
confirms that the inspection operation needs to be carried out, the supervisor contacts
the operator through the walkie-talkie, informs the operator of the line and tower
number to be inspected, and the operator fills in the inspection operation ticket
and executes it. After all operations are completed every day [23,
24], the paper operation ticket shall be submitted to the supervisor, and the tools,
drawings and atlas shall be returned. Principal component analysis formula and Euclidean
distance formula are shown in Eqs. (3) and (4).
On the other hand, the supervisor checks the planned operation table submitted by
the operator, contacts the operator through the walkie-talkie to understand the situation
of the operation site, and verbally issues unplanned operation and inspection operation
according to the unexpected situation and inspection demand reported by the operator.
After the daily operation, the paper operation ticket is filed, and the operation
data is statistically analysed [25].
3.2. Existing Problems
Through the investigation, it is found that there is still a certain distance from
the degree of informatization, and there is a lack of effective supervision for out-of-town
operation. Specific problems are as follows:
The level of informatization is low, and the operation ticket, equipment and personnel
information are all recorded with paper materials. When working on the spot, the operators
need to carry a large number of documents and drawings to the site, and search the
equipment information and geographic information on the spot. Facing the data with
dense words on the page of dynamic auxiliary numbers, the query efficiency is extremely
low, and the lack of three information management schemes cannot realize information
sharing, resulting in the phenomenon of information isolated island. There is no recording
scheme on site, so it is impossible to record the situation of on-site operation,
check the actual situation of operation completion after the operation is completed,
and trace the source of the problem. There is a lack of effective supervision in the
operation process, and it is impossible to check the efficiency and operation safety
of the operators, which leads to the loopholes of supervisors, which leads to the
loose behavior of the operators, and is prone to false reports and omissions of operations,
and even causes operation accidents due to irregular operations.
3.3. Overall Objective
In order to solve these problems, it is necessary to design a set of solutions to
achieve information, realize effective supervision of the whole process of power operation,
establish a remote communication mechanism, realize remote operation command, and
effectively improve the efficiency and safety of power operation.
The overall objectives of the power operation monitoring and command system are as
follows: to provide operators with intelligent terminal equipment that meets the safety
standards of the power industry, to record the action track of operators in real time,
and to collect and transmit live videos; Realize information management of power operation
ticket data, power lines, risks and measures, and adopt the whole process management
idea to complete the management of each link in the power operation process; The working
conditions of the operation site can be broadcast live by video, and the supervisors
can monitor and direct the on-site operation through voice communication with the
operators, and mark the problematic pictures in the video, so as to realize the traceability
of the problems. Similarity measurement formula and covariance formula are shown in
Eqs. (5) and (6).
4. Overall Design of Intelligent Terminal
4.1. Personnel Monitoring Equipment based on BeiDou GNSS Positioning Technology
The operating personnel positioning system, grounded in BeiDou positioning technology,
comprises two integral components: the software data analysis system and the hardware
data acquisition system. The hardware system bears the primary responsibility of capturing
real-time positional information of the operating personnel, while the software system
meticulously undertakes the subsequent analysis and processing of the data transmitted
by the hardware, ensuring comprehensive insight and efficient utilization of positional
data. Fig. 5 shows the overall framework of the system. The BeiDou mobile terminal equipment collects
real-time position information sent by BeiDou satellite in the process of personnel
operation, and then transmits it to the master station software through the communication
channel for data analysis and calculation.
Fig. 5. BeiDou GNSS-based personnel positioning equipment.
Hardware and software are divided into online and offline communication modes, online
communication mode is divided into wifi communication and mobile network communication,
first of all, wifi communication mode is mainly using wifi and base station equipment
to transmit data to the ground server, the communication mode is low cost, the system
is taking a high degree of sex but does not apply to long-distance communication,
when the distance between the tower A and the tower B is far away, there is a ground
receiving equipment may not receive the information problem. When the distance between
tower A and tower B is far, there is the problem that the ground receiving equipment
may not receive the information. Mobile communication mode can well avoid the problem
of long-distance information transmission in wifi communication mode, but the communication
mode is greatly affected by the environment, some towers may be built in remote mountainous
areas where the network is not good, and in some places the network can’t even cover
the area, and in such an environment, it can only be used in the offline communication
mode for data acquisition.
Offline communication mode is in the data acquisition project, that is, the staff
carries the Beidou mobile station equipment from tower A to tower B in the project,
the mobile equipment will temporarily store the data to the automatic with memory,
when the data acquisition is completed after the equipment will be brought to the
place where the signal is smooth to the data can be transmitted to the data analyzing
server, the way to make up for the lack of on-line communication ensures that the
transmission of data, although the problem of data transmission is solved, but the
data can only be transmitted by off-line communication mode, which can only be used
in the data acquisition project. Although it solves the problem of data transmission,
the measurement of the system does not reach real-time. Although each of the three
communication methods has its own advantages and disadvantages, they cover all the
data transmission problems brought about by the external environment, and the operator
can use any one of them to transmit data according to the different measurement environments
and requirements. According to the different communication modes of hardware and software,
the operation environment is also different, such as Fig. 6 shows the operation environment of the system under the online wifi communication
mode. The GPS signal receiving device within the system initially acquires data, which
is then verified against a calibration device to ensure accuracy. Following verification,
the calibrated data is seamlessly transmitted to the interconnected wifi1 device.
Subsequently, the wifi1 device relays the data to the wifi2 device, which in turn
forwards it to radio A. Radio A subsequently transmits the data to radio B, establishing
a communication link. Notably, radio B and the processor are directly connected via
a serial port, enabling the processor to promptly access and process the BeiDou data
without intermediaries, ensuring efficient and direct data acquisition.
Fig. 6. Hardware composition of personnel positioning equipment based on BeiDou GNSS.
4.2. AR System Components
Augmented reality technology involves a variety of fields such as computer vision
technology, computer graphics technology, human-computer interaction technology, etc.
In this paper, we take the augmented reality display technology using perspective
helmet display, and the basic composition of this augmented reality system is shown
in Fig. 7.
Fig. 7. Architecture of the AR system.
In this system, it mainly includes four parts: tracking registration module, virtual
information generation module, virtual-reality fusion module and display output module.
4.2.1 Tracking and registration module
Tracking registration module is the core module of the augmented reality system, which
can realize the precise integration of virtual information and real environment. First
of all, in order to enable the user to perceive the real environment in which the
user is located, the device can detect the angle of the user’s line of sight in real
time and accurately through the camera, track the target of the user’s gaze, accordingly
obtain the tracking information, and accordingly calculate the coordinates of the
position in the real environment in the three-dimensional virtual environment, so
as to accurately superimpose the virtual information into the real environment.
4.2.2 Virtual information generation module
The main function of the virtual information generation module is to generate virtual
information that can be displayed. In the augmented reality system, the real environment
is directly captured by the video camera, while the virtual information must be generated
by the computer. The 3D simulation software installed in the computer is used to design
3D virtual information, and then through a series of spatial conversion, virtual information
can be generated to be displayed by the augmented reality system.
4.2.3 Virtual reality fusion module
The main function of the virtual-reality fusion module is to fuse the virtual information
with the real environment, and the virtual-reality fusion module is based on the information
of the tracking registration module. The fusion effect of the virtual-reality fusion
module directly determines the effect of the virtual-reality integration of the augmented
reality system display.
4.2.4 Human-computer interaction module
The human-computer interaction module is the bridge between the user and the system,
which can realize efficient interaction with the operating system through the user’s
gaze and specific hand movements, and complete specific functions to improve the efficiency
of the inspection operation.
When the AR system is working, the head tracker will detect the change of the user’s
position and the change of the head view in real time. The video camera will capture
images of the user’s current real environment, and the captured real images are fed
into the virtual-reality fusion module, waiting to be fused with the virtual information.
The head tracker will capture the user’s position information and input it to the
tracking registration module, which performs tracking and registration to calculate
the coordinates of the virtual information in the real environment coordinate system.
At the same time, the virtual information generation module generates corresponding
virtual information and feeds it into the virtual-reality fusion module. At this time,
the virtual-real fusion module has real environment information, virtual information
and tracking and registration information, according to these three kinds of information,
the virtual-real fusion module will fuse the virtual and real information, and then
drive the display output module to display the mirror image. The human-computer interaction
module can naturally interact with the virtual information in the real environment.
4.3. Terminal Design
As an information collection and processing device, intelligent terminal covers hardware
and software, among which hardware is the foundation of the whole module [26]. Only by acquiring, storing and transmitting valuable data through intelligent terminal
hardware can the overall function of the system be better realized with software.
To ensure the safety of operators and facilitate real-time documentation of operational
procedures, it is imperative that operators wear safety helmets equipped with intelligent
terminals. This integrated solution comprises a safety helmet, an integrated high-definition
camera, and an advanced mobile terminal. The software aspect primarily encompasses
four core functionalities: operational information management, live streaming of on-site
videos, voice-based communication and command capabilities, as well as real-time positioning
of the terminal. This comprehensive approach ensures that not only are operators protected
but also that their actions are accurately recorded and communicated in a seamless
manner [27]. At the same time, in order to ensure the continuous application of the intelligent
terminal in the continuous long-term operation on the job site, the intelligent terminal
also needs to be equipped with standby batteries and thermal insulation accessories.
Fig. 8 shows chart of historical changes in user satisfaction.
Fig. 8. Chart of historical changes in user satisfaction.
4.4. Hardware Design of Intelligent Terminal
In order to meet the needs of power operation monitoring and operator safety, the
intelligent terminal adopts ABS safety helmet, high-definition industrial camera and
intelligent mobile terminal.In order to improve the safety and comfort of electric
operators in the operation process, the environmental characteristics of the large
outdoor temperature change range in northeast China, the intelligent terminal safety
helmet adopts ABS plastic material, chemical corrosion resistance, heat resistance,
hardness, high elasticity and toughness [28]. ABS plastic has low mass density, which is suitable for making safety helmets with
light requirements, so that operators can wear them for a long time.
4.4.1 ABS safety helmet
ABS reinforced plastic materials are used to make ABS safety helmets. ABS reinforced
plastic materials have strong resistance, strong chemical resistance and low mass
density. The helmet weighs only 390g and is suitable for long-term wearing [29]. At the same time, the cap shell is equipped with four-point cap lining, which can
effectively disperse the impact force from outside the cap shell to ensure the safety
of users and enhance the comfort of users when wearing. The correlation coefficient
formulas and cluster analysis formulas are shown in Eqs. (7) and (8).
4.4.2 HD industrial camera
The terminal incorporates a high-definition industrial camera, boasting an impressive
8 million physical pixels, capable of supporting 1080P high-resolution photography
and video recording for unparalleled clarity. The camera's extension cord features
an innovative partial spiral design, offering a broad range of adjustable lengths
to suit various needs. This design also minimizes tangling and breakage, thereby extending
the camera's service life and enhancing its durability. Fig. 9 shows trend diagram of the performance statistics.
Fig. 9. Trend diagram of performance statistics.
4.4.3 Intelligent mobile terminal
In order to cope with the outdoor environment with large temperature variation range
and possible rain and snow weather, the terminal shell is made of plastic material,
and an integrated molding process is adopted to enhance the waterproof ability of
the terminal. Super-large capacity lithium-ion battery can provide power for a long
time in low temperature environment [30]. Fig. 10 shows real-time monitoring data trend chart.
Fig. 10. Real-time monitoring data trend chart.
4.5. Software Design of Intelligent Terminal
Use intelligent terminal to record the video of electric power operation site, and
record the real-time operation situation for subsequent operation inspection. In order
to reduce the memory resource occupation of real-time operation of intelligent terminal,
reduce the possibility of video file error at the same time, and facilitate the subsequent
video to be transferred to the video cloud platform for long-term storage, the video
recording adopts a segmented recording scheme, and a video file is generated every
5 minutes. The related video of each job is stored in a folder named after the job
number, and the video file is named after the time when the file was created. If the
video started recording at 9:12:15 on May 27, 2023, the video file name is 20230527091215
MP4. The video folder for all jobs of the day is placed under a folder named after
the date of the day. When the supervisor needs to view the live video of the terminal
when viewing the job, click the button of view the live video of the terminal on the
page, and the intelligent terminal switches from the video recording state to the
live video state. Concurrently, the video cloud initiates live recording, while the
intelligent terminal dynamically adjusts its video bitrate in response to network
conditions, ensuring optimal video quality. Upon completion of the day's operations,
the operator transports the intelligent terminal equipment to the team station, connects
it to the team's computer, and navigates to the system webpage via the computer. From
there, they select the terminal's video folder, seamlessly uploading the footage to
the cloud platform. This process culminates in the storage of the comprehensive video
file on the cloud, facilitating effortless on-demand access and subsequent operations.
Fig. 11 shows real-time power load trend diagram.
Fig. 11. Real-time power load trend diagram.
In the process of video recording, in order to ensure the quality of video recording,
supervise operators and prevent unexpected situations, intelligent terminals need
to intelligently detect video pictures. Typical abnormal situations are that operators
put intelligent terminal equipment somewhere when they go slow or the ambient brightness
is too high or too low when monitoring, which affects video quality. Therefore, intelligent
terminals need to detect static pictures and abnormal brightness of video to improve
the enthusiasm of operators. Motor efficiency formula and transformer ratio formula
are shown in Eqs. (9) and (10).
4.6. Terminal Real-time Positioning
Typically, a range of technologies including GPS, base station positioning, and WiFi
positioning are employed to achieve real-time terminal positioning. However, given
the prolonged outdoor usage of the intelligent terminal in this system, WiFi-based
positioning technology is not feasible due to its limited range and reliance on nearby
networks. To enhance the precision of terminal positioning, the system ingeniously
integrates GPS and base station positioning technologies, harnessing their respective
strengths to swiftly obtain high-accuracy positioning information, thereby ensuring
reliable and accurate location tracking even in diverse environments. Because of the
high-power consumption of GPS-based positioning technology, in order to reduce the
power consumption of terminal equipment and prolong its effective working time, terminals
usually use terminals to receive signals from nearby base stations to realize real-time
positioning. In order to ensure the real-time positioning without omission when the
application is in the background, the terminal uses Notification to improve the process
priority of positioning service. The system saves real-time positioning coordinates
in the cloud for trajectory playback when the job is reviewed. The power factor formula
and apparent power formula are shown in Eqs. (11) and (12).
5. Discussion and Conclusion
Monitoring and commanding the whole process of electric power operation is beneficial
to improve the efficiency of electric power operation and reduce the probability of
electric power accidents. This paper puts forward the corresponding solution, that
is, the use of BeiDou GNSS to realize the positioning of power inspectors, and through
augmented reality technology to assist the inspection, and then use the mobile intelligent
terminal to record and broadcast the whole process of power operation, to realize
the monitoring and command of power operation. The main work done is:
The characteristics of the intelligent terminal are studied. Aiming at the problems
of long-term continuous operation in power operation and large temperature changes
in the power operation environment, the intelligent terminal suitable for power operation
is designed to locate the position of the operator in real time and use AR technology
to assist inspection, which improves the safety and efficiency of the operation;
The transmission and storage scheme of video and audio in video surveillance command
is designed, and the video medium is established by Tencent Cloud Platform, and a
complete video file set is formed on the cloud platform;
Based on the whole process management idea, the whole process management scheme is
designed for several objects involved in the power operation process, and a closed-loop
management strategy is formed to manage resources efficiently.
References
M. Valizadeh , B. Ranjgar , A. Niccolai , H. Hosseini , S. Rezaee , F.
Hakimpour , Indoor augmented reality (AR) pedestrian navigation for emergency evacuation
based on BIM and GIS, Heliyon, Vol. 10, No. 12, Art. no. e32852, 2024
E. Stylianidis , E. Valari , A. Pagani , I. Carrillo , A. Kounoudes , K.
Michail , K. Smagas , Augmented reality geovisualisation for underground utilities,
PFG-Journal of Photogrammetry, Remote Sensing and Geoinformation Science, Vol. 88,
No. 2, pp. 173-185, 2020
Y. Wang , J. Kuang , X. Niu , J. Liu , LLIO: Lightweight learned inertial
odometer, IEEE Internet of Things Journal, Vol. 10, No. 3, pp. 2508-2518, 2023
C. Drubin , Precision GNSS in automotive: A reality by 2021, Microwave Journal,
Vol. 59, No. 11, pp. 53, 2016
B. F. G. Katz , F. Dramas , G. Parseihian , O. Gutierrez , S. Kammoun ,
A. Brilhault , L. Brunet , M. Gallay , B. Oriola , M. Auvray , P. Truillet
, M. Denis , S. Thorpe , C. Jouffrais , NAVIG: Guidance system for the visually
impaired using virtual augmented reality, Technology and Disability, Vol. 24, No.
2, pp. 163-178, 2012
M. Koeva , M. Luleva , P. Maldjanski , Integrating spherical panoramas and
maps for visualization of cultural heritage objects using virtual reality technology,
Sensors, Vol. 17, No. 4, Art. no. 829, 2017
M. Z. A. Muthalif , D. Shojaei , K. Khoshelham , A review of augmented reality
visualization methods for subsurface utilities, Advanced Engineering Informatics,
Vol. 51, Art. no. 101498, 2022
C. Drubin , Precision GNSS in automotive: A reality by 2021, Microwave Journal,
Vol. 59, No. 11, pp. 53, 2016
Ş. Şafak , İ. Tiryakioglu , H. Erdoğan , H. İ. Solak , B. Aktuğ , Determination
of parameters affecting the accuracy of GNSS station velocities, Measurement, Vol.
164, Art. no. 108003, 2020
C. Molina , A. Camps , First evidences of ionospheric plasma depletions observations
using GNSS-R data from CYGNSS, Remote Sensing, Vol. 12, No. 22, Art. no. 3782, 2020
P. Zalewski , M. Bilewski , GNSS measurements model in ship handling simulators,
IEEE Access, Vol. 7, pp. 76428-76437, 2019
J. Ma , Z. Yao , M. Lu , N. Guo , Band-limited dual-frequency multiplexing
technique for GNSS signals, GPS Solutions, Vol. 25, No. 2, Art. no. 78, 2021
Q. Zhang , Z. Chen , Y. Cui , X. Zheng , F. Rong , Y. Sun , L. Gao ,
A refined metric for multi-GNSS constellation availability assessment in polar regions,
Advances in Space Research, Vol. 66, No. 3, pp. 655-670, 2020
L. O. Orlandi , K. Depedri , N. Conci , Spatial-temporal calibration for outdoor
location-based augmented reality, IEEE Sensors Journal, Vol. 24, No. 11, pp. 18382-18391,
2024
Y. Wang , N. Ding , Y. Zhang , L. Li , X. Yang , Q. Zhao , A new approach
of the global navigation satellite system tomography for any size of GNSS network,
Remote Sensing, Vol. 12, No. 4, Art. no. 617, 2020
A. Ferreira , B. Matias , J. Almeida , E. Silva , Real-time GNSS precise
positioning: RTKLIB for ROS, International Journal of Advanced Robotic Systems, Vol.
17, No. 3, Art. no. 1729881420904526, 2020
I. Grgac , R. Paar , Quality assessment of Locata positioning system, Journal
of Applied Geodesy, Vol. 14, No. 1, pp. 95-112, 2020
D. M. Anderson , R. E. Estell , J. L. Holechek , S. Ivey , G. B. Smith ,
Virtual herding for flexible livestock management–A review, The Rangeland Journal,
Vol. 36, No. 3, pp. 205-221, 2014
X. Yang , G. Chang , Q. Wang , S. Zhang , Y. Mao , X. Chen , An adaptive
Kalman filter based on variance component estimation for a real-time ZTD solution,
Acta Geodaetica et Geophysica, Vol. 54, No. 1, pp. 89-121, 2019
Y. Fan , Z. Feng , A. Mannan , T. U. Khan , C. Shen , S. Saeed , Estimating
tree position, diameter at breast height, and tree height in real time using a mobile
phone with RGB-D SLAM, Remote Sensing, Vol. 10, No. 11, Art. no. 1845, 2018
E. Falletti , D. Margaria , G. Marucco , B. Motella , M. Nicola , M. Pini
, Synchronization of critical infrastructures dependent upon GNSS: Current vulnerabilities
and protection provided by new signals, IEEE Systems Journal, Vol. 13, No. 3, pp.
2118-2129, 2019
B. Paláncz , L. Völgyesi , A numeric-symbolic solution of GNSS phase ambiguity,
Periodica Polytechnica Civil Engineering, Vol. 64, No. 1, pp. 223-230, 2020
D. Treccani , A. Adami , V. Brunelli , L. Fregonese , Mobile mapping system
for historic built heritage and GIS integration: A challenging case study, Applied
Geomatics, Vol. 16, No. 1, pp. 293-312, 2024
X. Li , M. Ge , X. Dai , X. Ren , M. Fritsche , J. Wickert , H. Schuh
, Accuracy and reliability of multi-GNSS real-time precise positioning: GPS, GLONASS,
BeiDou, and Galileo, Journal of Geodesy, Vol. 89, No. 6, pp. 607-635, 2015
M. Poniatowski , G. Nykiel , Degradation of kinematic PPP of GNSS stations in
Central Europe caused by medium-scale traveling ionospheric disturbances during the
St. Patrick’s Day 2015 geomagnetic storm, Remote Sensing, Vol. 12, No. 21, Art. no.
3582, 2020
S. Susilo , R. Salman , W. Hermawan , R. Widyaningrum , S. T. Wibowo ,
Y. A. Lumban-Gaol , I. Meilano , S.-H. Yun , GNSS land subsidence observations
along the northern coastline of Java, Indonesia, Scientific Data, Vol. 10, No. 1,
Art. no. 421, 2023
A. Elmezayen , A. El-Rabbany , Performance evaluation of real-time tightly coupled
GNSS PPP/MEMS-based inertial integration using an improved robust adaptive Kalman
filter, Journal of Applied Geodesy, Vol. 14, No. 4, pp. 413-430, 2020
P. Bosser , O. Bock , C. Flamant , S. Bony , S. Speich , Integrated water
vapour content retrievals from ship-borne GNSS receivers during EUREC4A, Earth System
Science Data, Vol. 13, No. 4, pp. 1499-1517, 2021
S. Jin , G. P. Feng , S. Gleason , Remote sensing using GNSS signals: Current
status and future directions, Advances in Space Research, Vol. 47, No. 10, pp. 1645-1653,
2011
I. J. Hamling , T. J. Wright , S. Hreinsdóttir , L. M. Wallace , A snapshot
of New Zealand’s dynamic deformation field from Envisat InSAR and GNSS observations
between 2003 and 2011, Geophysical Research Letters, Vol. 49, No. 2, Art. no. e2021GL096465,
2022
Wei Zhang (1984, September), Male, Han, Shanxi, Guizhou University, Bachelor’s Degree,
Guizhou Power Grid Intelligent Operation Center, Deputy General Manager of Safety
Production Management Department, Senior Engineer, Transmission Operation and Intelligent
Technology Research and Application.
Jinyong Ou Guizhou Power Grid Intelligent Operation Center, Intelligent Transmission
Management specific responsibility, Engineer, Research Direction: Intelligent Power
Transmission.
Kaifeng Deng (1995.03), male, Miao, Kaili, Guizhou, Kunming University of Science
and Technology, Bachelor’s Degree, Intelligent Operation Center of Guizhou Power Grid
Limited Liability Company, specific responsibility , Assistant Engineer, Research
Direction: Intelligent Power Transmission Technology.