Kneron KL630 Series: AI SoC for Next-Generation Smart Cameras

Hedy · Dasenic Oct 01,2024 107

The Kneron KL630 series, built on TSMC’s advanced 28nm technology node, is a state-of-the-art System on Chip (SoC) designed for a diverse range of professional and consumer IP cameras. These include security cameras, home surveillance cameras, video doorbells, stabilization cameras, 180° and 360° panoramic cameras, and those integrated into home appliances and robotics. The KL630 series offers a robust platform for rapid development of high-quality multi-lens camera applications with up to 4 video input channels. It features an advanced multi-ISP pipeline with capabilities such as multi-exposure HDR fusion and cutting-edge video quality enhancements tailored for wide-angle lenses and sensors.

Key Features and Innovations

1. Flexible Neural Processing Unit (NPU):

Kneron leads in reconfigurable NPU technology, enabling dynamic memory access and precision adaptability to different neural network data types. Its fourth-generation NPU supports concurrent execution of both CNNs and Transformers, making it versatile for machine vision and semantic analysis tasks. This innovative approach, which balances high ASIC performance with programmable flexibility, provides low-power, high-efficiency solutions for a variety of AI applications.

2. Superior Image Recognition Software:

The KL630 series integrates lightweight AI algorithms for facial recognition, gesture detection, and object or scene identification. Its standard SDK includes pre-trained models for quick deployment, ensuring low-latency, high-accuracy performance across diverse environments.

3. Advanced Fifth-Generation ISP:

The integrated fifth-gen ISP captures images and videos with realistic color gradations, reduced noise, and perceptible detail. Noteworthy features include:

Dynamic Color Compensation to ensure smooth color transitions.

HDR Technology for richer, more accurate color reproduction in high-contrast scenes.

Smart Edge Enhancement to correct local blurring caused by slight lens misalignment.

Multi-Sensor ISP Integration to manage color and brightness inconsistencies from various sensors.

4. Smart HEVC Encoder:

The intelligent HEVC encoder minimizes unnecessary data transmission while maintaining superior video quality. Features include:

Dynamic ROI and Noise Reduction for motion-heavy scenes.

Efficient Compression that reduces bandwidth usage and storage costs by up to 60% compared to H.264 encoding.

5. Fisheye Correction and Stitching:

The built-in fisheye correction engine can handle real-time dewarping for up to 360° video streams. It utilizes hardware acceleration to optimize CPU usage, offering high-quality panoramic video processing with geometric correction for wide-angle lenses.

6. On-Device AI for Real-Time Video Analysis:

The KL630 series uses AI-driven algorithms for real-time detection of humans, pets, vehicles, and other objects of interest. This approach ensures enhanced privacy, reduced data latency, and localized data processing for quick, on-site task execution.

7. Audio Enhancement and Smart Processing:

Leveraging machine learning, the system improves audio signal processing with features like noise suppression, echo cancellation, and dynamic range control. Compared to conventional solutions, it delivers high performance with up to 30% less computational resource consumption.

8. High-Performance Tools:

PQ Tool provides a comprehensive image adjustment interface with customizable settings.

Fisheye Correction Tool allows real-time correction and preview for wide-angle lens outputs.

Application Scenarios and Specifications

KL630 Series Configurations:

Security and Home Cameras: Designed for enhanced surveillance with seamless integration of AI recognition algorithms.

Automotive DVRs (KLR5S3 Series): Optimized for in-vehicle use with advanced EIS for image stabilization against motion blur.

Industrial Cameras (KLI5S3 Series): Engineered for precision imaging in demanding industrial environments.

Electronic Image Stabilization (EIS):

The KL630 series employs digital image stabilization techniques using gyroscope data to counteract camera shake and rolling shutter effects, ensuring smooth and clear video output even in dynamic environments.

►Scenario application diagram

►Display board photo

►Solution Block Diagram

►Core technology advantages

1. Reconfigurable NPU 2. Image recognition software 3. Fifth-generation ISP can record images and videos with perceptible details, true tonal gradation and lower noise 4. Intelligent HEVC encoder significantly reduces useless or unimportant data as much as possible , and maintain high-quality video without interrupting network bandwidth 5. Fisheye engine to distort, splice, and mix 6. Intelligent video analysis 7. Audio enhancement and intelligence 8. High-performance application tools PQ Tool and Fisheye Correction Tool

►Solution Specifications

KL630 Series AI Camera KLR5S3 Series (Car DVR) KLI5S3 Series (Industrial Cam)

Conclusion

The Kneron KL630 series is a comprehensive solution for next-gen smart cameras, offering high flexibility, advanced AI capabilities, and cutting-edge video processing. Its ability to support both consumer and industrial applications makes it a standout choice in the evolving AI camera landscape.


  • RFQ