Hybrid SAN & Cluster Enterprise Network Storage Hikvision - - PowerPoint PPT Presentation
Hybrid SAN & Cluster Enterprise Network Storage Hikvision - - PowerPoint PPT Presentation
HIKVISION Storage Products Hybrid SAN & Cluster Enterprise Network Storage Hikvision Enterprise Network Storage History CONTENTS Network Storage Solutions Network Storage Products Network Storage Cases HIK Enterprise Network
CONTENTS
- Hikvision Enterprise Network Storage History
- Network Storage Solutions
- Network Storage Products
- Network Storage Cases
HIK Enterprise Network Storage History
Development History
Over the last 14 years, Hikvision storage device has been the storage leader for surveillance storage. We started to research SAN products in 2004 and now we are the worldwide largest private cluster storage provider.
2004
The Establishment
- f Hikvision storage
2005
Launched 10 Gigabit IP Network storage & FC SAN
2008
Launched hybrid SAN products which focus on CCTV
2010
Started to research Cluster storage for CCTV
2013
Applied cluster storage in surveillance
2015
More than 1000+ cluster successful cases
2016
IDC & IHS Rank No.1
2018
Cluster & AI & Big data
CCTV Storage Leader
Rank No.1 for surveillance storage
NO.1
First to develop Video direct stream technology First to develop picture direct stream technology First to release CCTV cloud storage solution First to develop video+ picture direct stream technology
100 PB
100 PB is applied to the large safe city project
First IHS
Hikvision Remarkable Achievement in CCTV
#1 Worldwide
Market share for SAN storage used in surveillance
with 22.1% market share (in 2016) by IHS Research
#1 the largest private cluster storage
provider
#1 the installed capacity is 5000 PB in
2016
Remarkable Achievements
Network Storage Solutions
Types of Main Stream Storage – DAS/NAS/SAN
DAS NAS
NFS, CIFS
Application Server File System
RAID
SCSI
FC Switch Ethernet Switch
Application Server Application Server
RAID
File System
SAN
Application Server File System
RAID
Ethernet Switch
iSCSI
Application Server File System
RAID
Belong to network file system
DAS: Directly Attached Storage (out) Limited by server’s CPU, I/O ability. When expanding storage device, the server should be powered off. Data back up takes long time. NAS: Network Attached Storage File level storage. Ideal for file sharing, pictures sharing, video sharing(FTP). Reading speed faster than write speed. Data back up occupy network speed. SAN: Storage Area Network IP SAN & FC SAN, FC SAN with high speed, mainly based on iSCSI protocol. Data spreads in so many HDDs, applications can visit all HDDs directly, high writing speed.
Storage Technology & Surveillance
Logical Volume Logical Volume Logical Volume Logical Volume Logical Volume Logical Volume
HDD Disk Array Controller
SAN
FC/IP FC/IP
Disk Array
- Peripheral
- Applied for application
to access data
- Shared for devices,
exclusive for data
SAN Switch
Application Software File System Database
Logical Volume Logical Volume Logical Volume
Application Software File System Database
Logical Volume Logical Volume Logical Volume
Operating System
Application Server
SAN
Operating System
Storage IPC Storage Server Forwarding Server
Disadvantages:
Video reading and writing should be done through platform server High construction cost, performance bottleneck The traditional file system periodically covers data and a large number of fragments. Server failure can cause file system damage and data loss.
Advantages:
Open and standard iSCSI Protocol Centralized storage, easy to manage Easy to extend storage capability High data searching efficiency
IP SAN (Platform Server) Surveillance Solution
Storage Technology & Surveillance
Direct Streaming Write Technology
101010
Storage Server IP SAN/ NAS
10110011010110101101010010101 10011010110101101010010 01011001101011010110101001010 11001101011010110101001 010101
) ( Longer chain, transfer data with storage sever Prone to failure and performance bottleneck The video read & write need to wait after file generation High cost because of extra storage server
Hybrid SAN Storage
1011001101011010101010100000111001010101001010100011010101111000101010 0101100110101101010101010000011100101010100101010001101010111100010101
Shorter chain, high efficiency Eliminate SPF and performance bottleneck Low cost because of no need for storage server
ISCSI/CIFS/NFS Direct Streaming
1101110000111001010101010 1010101010110101010110101 1011101010101100101010101 1010101011010111001010110
High-density time coordinate and precise retrieval; High streaming write efficiency, no file fragmentation; Video can be stored or read without delay; Storage System can overwrite data automatically; No performance decline for 7*24.
Video direct Streaming storage (Hybrid SAN) Generic data storage (IPSAN/NAS)
Inefficient file retrieval; Inefficient file storage write with file fragmentation issues; File storage requires a fixed-format file generation to read; VMS is required to realize deletion of data periodically; long-term performance tend to decrease.
Faster Data Retrieval With Hikvision Video Direct Streaming
Timer 01
7*24h
Timer N
Positioning retrieval in seconds Gop Video data Time coordinate
Jan.10th, 2019 _01.MP4 Jan.1st, 2019 _01.mp4
File storage
January 1st. 10th.
Jan.1st, 2019 _02.mp4 Jan.10th, 2019 _02.MP4
Hikvision Video Direct Streaming Storage Solution
Hikvision Video Direct Streaming Storage
Management Server
IPC
Forwarding Server
Features:
Video stream writes directly into storage device, eliminating storage server costs, avoiding single point of failure and server performance bottlenecks; Standard ONVIF and RTSP support for 3rd Camera access; SDK available for 3rd VMS integration
ANR
Hybrid SAN support ANR function, the video would storage in NVR/IPC (Edge Storage) when network disconnect. It will draw video back into hybrid SAN when network come back normal.
To realize backup of critical video in challenging network Not lose video from cameras in critical places
Advanced Video Technologies to Ensure Safety
Schedule backup
The video can be stored in NVR or Edge storage in the daytime when network is heavy load. It can schedule back up the video from NVR or edge storage at night when network is idle
Several Kinds of Standard RAID
Widely used RAID: RAID 0; RAID 1; RAID 5; RAID 6; RAID 10 HDD usage efficiency: RAID 0>RAID 5>RAID 6>RAID 10> RAID 1 How many HDD gets bad the system still work: RAID 0=0; RAID 1=half HDD; RAID 5=1; RAID 6=2; RAID 10=half HDD
Hardware-modularized design Easy to install and maintain; No cabling design, easy for trouble shooting.
Dual Controller Dual Power Dual Fan
Higher System Availability Design
Compared with the server architecture, the advantage of the controller architecture is reflected in full-mode wireless cable, supporting hot plug and better maintainability .
1 Hybrid SAN failover node can take over multiple failed host devices. When failed node goes back to normal, failover storage will transfer back video to host node.
Super N+1 Failover for Greater Reliability
Host storage Host storage Fail-over
Transfer back video Video recording
Strong System Scalability
Easy capacity expansion via Mini-SAS interface for up to 2 level expansion; Scale up with 2 level expansion enclosure are recommended in real project deployments; Mini-SAS Host storage Expansion enclosure Expansion enclosure Mini-SAS
Easy to Deploy and Maintain Solution
1. Create RAID 2. Form storage pool 3. Logical volumes Partition
- 4. Configure video volumes
Ready For Use by VMS
VMS configuration 1. Add IP of storage 2. Create recording plan
User-friendly system interface Unified platform management for easy system maintenance. Real-time monitoring of the operation status of key components;
1 Click operation
VMS Client
Center Site
Local site
Benefits:
NVRs for HD resolution recording at local site Enterprise network storage for long time retention in Center, saving video footage for longer time to meet critical requirement; Much safer recording solution, Central site play back not influenced by NVR problem or network problem
Dual Layers Storage Solution for Multiple Sites Project
Enterprise network storage
IP/TCP
Network Camera NVR Network Camera NVR
Scheduled Backup from NVR/DVR/MVR/PVR
HD video can be stored locally(in NVR/DVR/MVR/PVR) at day time using LAN NVR/DVR start to transfer back to Hybrid SAN, When network is free according to pre-configured rule Effective video back up solution when transmission condition is limited
Up to 10 node to be monitored 智能
NVR DVR Hybrid SAN Channel No Starting time MVR PVR
Benefits:
More efficient centralized storage; More simple network structuring and more easy capacity extension. Network storage devices have high concurrent write performance. Among the currently released devices, the maximum of 2Mbps front-end: 1024-ch.
Centralized Storage for Large Camera Number Project
Network Camera Network Camera VMS Client Enterprise network storage
NOTE: Very large-scale projects (above 1 PB), it is recommended to use Cluster Storage and platform to cooperate with each others to achieve the overall control of the solution
70-ch 4 Mbps 100-ch 4 Mbps 200-ch 4 Mbps 14-ch 10 Mbps 20-ch 10 Mbps 40-ch 10 Mbps
Benefits:
2 MP videos backup requiring 4 MP bandwidth HD video stored at vehicle’s mobile recorder; Mobile recorder can back up video from mobile recorder to Enterprise network storage Via WIFI
Mobile Backup Solution
Mobile Recorder 5.8G WIFI MVR 5.8G WIFI AP
LAN
IVMS-5200P Enterprise network storage Mobile Recorder
DS-A80/81 DS-A82 DS-A72
Benefit:
Easy expansion of NVR, no change of network structure No need to change camera recording schedule set in NVR
NVR/Blazer Capacity Expansion
SAN Storage Capacity NVR Storage Capacity
NVR Network Camera Enterprise Network Storage iSCSI Switch
Long Tern Storage - the Tape Library Solution
Normally recording retain 30 to 90 days ,critical data retain 3 to 5 years. Hikvision hybrid SAN DS-A7 serial storage gets streams from IPC/NVR/DVR and connects to the tape library device via SAS line . The hybrid SAN local HDD use for schedule recording support retain 30 to 90 days and event recording will be backed up in the tape library retain 3 to 5 years.
Long term backup with the tape library
VMS Server
client
Video wall LAN Center Site B Site C
Network
DS-AL72024R
Network Recording Stream Playback Stream
DS-AL11109S
SAS Line Site A
Analog camera
DVR
Analog camera IPC IPC IPC IPC IPC
NVR
IPC IPC IPC IPC
Cluster Storage Summary
Cluster Storage
Virtualization
Scale-out
Distribution Data Rebuilt Direct streaming
视频监控平台
Front-end
- Hybrid storage
- Video & Picture direct
storage(ONVIF/RTSP)
Storage Node
- Support management server + storage
device deployment
- Support for no management server,
- nly storage device deployment
Platform
- HIK HC: Hik-central 1.4
- Connect with the 3rd-party
platform through HIK platform
System Features
Cluster Storage
Management Server
…
Cluster Storage 3.0 Series Physical Architecture
Video Picture File
- Support Cluster and provide unique external IP and resource virtualization
- Load balancing dynamic takeover of system resources, support flexible space configuration
Flexible Solution for Surveillance Storage
Micro Cluster
Small-scale project Distributed local storage Hierarchical scale-out
VMS Storage Node
Storage Node CVS&CVN&CVM
Standard Cluster & Image accelerated Cluster
VMS
Management Server CVS&CVN&CVM Medial & large scale project Centralized storage Capacity on demands
…… ……
No Management server Suggestion 1-10 devices Support up to 2000-ch Management Server + Storage Node Support up to 30000-ch and 300 devices
Cluster Storage 3.0 Series Key Features
Video
Storage Node 1 Storage Node 2 Storage Node 3
Data protection among HDDs Data protection among devices
Vide
- D1
D2 D3 D5 Storage Node 1
D1
Storage Node 2
D2
Storage Node 5
D5
P2 P1
D8
D6 D7 D8
D9 D10
Storage Node 3
D3 D6
P1 P2 P3
D9 D10 D12
P3
Storage Node 4
D4 D7 D11
D4
D11 D12
2 Data rebuild 2 TB per hour
High speed of data recovery
1 Constant data transmission and
business when device fails
3
Data read/write and system access without interruption by device failure
4
Playback/download can be continued when Maximum 4 devices broke down
IRAID(V3.0) Stand-alone RAID(V2.0)
Cluster Storage Solution
Face capture camera
Face picture
Data access service cluster Storage Big Data Service
端到端
Facial Recognition server
Retrieval Model Comparison Statistics Data Mining Alarm Control
This system supports face applications, such as real-time capture, real-time alarm, history alarm, 1V1 Comparison, search by picture, search face picture, ID authentication, etc.
FUNCTIONS
VMS
URL Structured data Command/ Result
Network Storage Products
DS–A L MMM NN U - VVV
DS-A: Hikvision Network Storage NULL: J: Host JBOD 710: 720: 806: 810: 820: 68: 78: Low performance server architecture High performance server architecture Low performance controller architecture Middle performance controller architecture High performance controller architecture 6Gb/s JBOD 12Gb/s JBOD 8/16/24/36/48/72: HDD Number R: S: D: Server architecture Single controller architecture Dual controller architecture CVS: ICVS: 2.0 CLUSTER STORAGE 3.0 CLUSTER STORAGE
1 2 3 4 5 6
Storage Product Name Rule
Server architecture
Storage Product HD Pictures
Dual controller Single controller JBOD
Cluster Storage Products Family
DS-A81048S-ICVS DS-A83024S-ICVS
HDD Slots 48 HDD 24 HDD
2.0 Series 3.0 Series
DS-A72048R-CVS DS-A72024R-CVS DS-A71048R-CVS DS-A71024R-CVS DS-A81024S-ICVS DS-A83048S-ICVS
Product Product Level Model Key feature Advantage VMS
Cluster High
DS-A83024S-ICVS DS-A83048S-ICVS DS-A81024S-ICVS DS-A81048S-ICVS
Cluster Load balance Unique IP Expansion online scale-out Rebuild 2 TB/Per hour, at most 4 device failure without data loss Hikvision Cluster solution Save totally TCO.
HCP
Middle
DS-A72024R-CVS DS-A72048R-CVS
Cluster Load balance Unique IP Expansion online scale-out
Status of Storage Key Models
Status of Storage Key Models
Product
Product Level Model Key feature Advantage VMS
Hybrid SAN
High
DS-A82024D DS-A83024D DS-A83030D DS-AJ7824D DS-AJ7872D
Dual Controller, support extend FC,10GB,support direct stream and IPSAN, Active-Active
Save totally TCO, cost less solution. Directing Stream Mode: Hikcentral,4200 Support integration with 3rd part VMS by SDK IPSAN mode: Milestone/ISS/Axx
- n/Digifort/Genetic
Middle
DS-A81016S DS-A80624S DS-AJ7824S
Single Controller, cost-effective Support direct stream and IPSAN
Low
DS-AT1000S/192 DS-AT1000S/336
With 24HDD (8 TB/14 TB) High cost-effective, only support direct stream
Solution Product
DS-A72024R DS-AL11109S
Tape solution for 5-8 years . MVR solution product.
Storage Product Show Network Storage
Hybrid SAN DS-A81016S DS-AT1000S DS-A80624S DS-A82024D DS-A72024R DS-A72072R DS-A83024D JBOD DS-AJ7824S DS-AJ7824D DS-AJ7872D
Network Storage Cases
Customer info
Hybrid SAN provide schedule backup function which can realize schedule backup from local storage (IPC, DVR or NVR) to Hybrid SAN. It can reduce network bandwidth pressure during working hours
Singapore Telecom --- Mobile one
Requirements and challenges
Limited budget and rack space Network bandwidth limited, in daytime busy but in nighttime free to use.
Project Background
Scheduled backup solution for limited network bandwidth M1 is Singapore’s most vibrant and dynamic communications company providing mobile and fixed services to over 2 million customers. Higher performance and lower rack space Hikvision hybrid SAN don’t need storage server by utilizing direct streaming technology thus lower total cost and lower rack space requirement
Hikvision Solution and Customer values
Singapore Telecom --- Mobile one
Schedule backup HDVR HDVR VMS Hybrid SAN
WAN/LAN
Project Background
Thailand Bank Project
Customer info Standard Chartered Bank PLC has more than 1,400 branches in over 50 countries and territories, employing 60,000 people. Requirements and challenges This bank has more than 2000 cameras spreading across different branches while having not too high resolution, customer looks for storage solution with higher camera number access capacity. Hikvision provides large camera access storage device for this project
Hikvision Solution and Customer values
This project has more than 2000 channel cameras, the bitrate of cameras is 512Kbps. Due to large camera access capacity of Hikvision Hybrid SAN solution, only 3 units storage device are used in this project.
Accessed thousands of cameras
More than 2000 cameras spread across different branches, Hybrid SAN help client realize centralized storage at ease
Centralized Storage
Thailand Bank Project
VMS Server Hybrid SAN Hybrid SAN VLAN 1 (WAN) VLAN 2 (WAN) Firewall
Safe City Project in Kiev Ukraine
Kiev is the capital of Ukraine, In early 2016 the Kiev city government proposed a safety city construction plan, to create a more peaceful, more intelligent living environment. Huawei, Dahua, Milestone and many other manufacturers have been involved, but HIKVISION finally won the tender because HIKVISION successfully meet the complicated demands, such as variety of surveillance scenes, centralized management & storage, compatible with third-party devices, high data security demand, complicated network environment, urgent project cycle etc.
Monitoring center VMS Cluster Storage Road School Hospital Bank Police Government Square
Project Background
Safe City Project in Kiev Ukraine
Model Qty of device HIKVSION Cameras 6000+ Third part Cameras 2000+ Storage Device 70 Storage Capacity 10 PB HIKVSION Cluster storage solution was applied, offering customers a massive storage solution with dynamic expansion, virtualization and clustering management, extreme high data safety, load balancing, etc.
` `Site1
Camera 1 LAN CMS 1 Camera 5 Switch VPN 1 Client (Optional) CVMS 1WAN VPN
Cloud Video System Platform
`CVMS: Cloud Video Manage Sever CVOS: Cloud Video Operation Sever CVSS: Cloud Video Storage Sever SMS: Stream Media Server CMS: Central Management Server
Video Wall 1 Keyboard 01 Decoder 01 ` SMS 05 SMS 01……
`Management center Monitor Sites
Video Stream
WAN 40Gb Switch `Site2
Camera 6 Camera 11 Switch VPN 2 Client (Optional) `Site512
Camera 4090 Camera 4096 Camera 4091 Switch VPN 512 Client (Optional)…… ……
CVMS 2 CVMS 3 cv cv CVSS 18 CVSS 1 CVSS 7 CVSS 6 CVSS 5 CVSS 4 CVSS 3 CVSS 2 CVOS DB VAG 01 VAG 03DB: DataBase
Other Server……
…… …… …… ……
Decoder 02 Decoder 03 DS-C10S-S11/EVAG: Manages all devices access to Platform
DS-C10S-S11/E DS-C10S-S11/E Video Wall 2 Video Wall 3 ` Decoder 04 Keyboard 03 Keyboard 02LAN
Hikvision Solution and customer benefits