gstreamer new plugin: webrtcsink and webrtcsrc

https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/tree/main/net/webrtc webrtcsink and webrtcsrc All-batteries included GStreamer WebRTC producer and consumer, that try their best to do The Right Thing™. It also provides a flexible and all-purposes WebRTC signalling server (gst-webrtc-signalling-server) and a Javascript API (gstwebrtc-api) to produce and consume compatible WebRTC streams from a web browser. Use case The webrtcbin element in GStreamer is […] →Read more

What’s LLM

生成式 AI 对于内容创作者来说, 既是机遇, 也是挑战。 LLM(Large Langage Model) 大语言模型之火愈演愈㤠。 国外的 ChatGPT, 国内的 Kimi 几乎成了与搜索引擎一样必不可少的工具。 AI 不但能理解我们的问题, 理解大篇幅的文本, 还能长篇累牍的生成大块文章, 还能生成图像, 视频, 音频, 这一天来得好快。 现在我写文章, 每当词穷之际, 就会求助于 LLM, 写程序, 忘了函数用法, 也不再查手册, 而去问 LLM, 但是它们是怎么做到的呢。 通过文本生成 token 想想婴儿是怎么学语言的吧, 词汇是基础 , token 就是 LLM 的词汇, BPE(Byte Paire Encoding) 算法广泛用于 LLM , 从给定的数据集中生成 token 通过 token 进行预测 以这句练打字常用的句子为例 the quick […] →Read more

TDD

Test-Driven Development (TDD) is an iterative development cycle that emphasizes writing automated tests before writing the actual feature or function. Put another way, TDD combines building and testing. This process not only helps ensure correctness of the code — but also helps to indirectly evolve the design and architecture of the project at hand. TDD […] →Read more

把一件很难的事情拆分的足够小

把大象放进冰箱有三个步骤 打开冰箱门 把大象放进冰箱 关上冰箱门 显然, 这个拆分是不合格的, 第一步和第三步没问题, 第二步太粗. 拆分得尽量小, 顺序安排合理, 做起来就更容易 →Read more

成为自己的教练

其实也就一个 PDCA 循环 自己为自己设计课程 自己督促自己学习和训练 自己反省自己的问题 自己采取行动改进自己 →Read more

Schedule mode: push or pull

Overview The scheduling mode of a pad defines how data is retrieved from (source) or given to (sink) pads. GStreamer can operate in two scheduling mode, called push- and pull-mode. GStreamer supports elements with pads in any of the scheduling modes where not all pads need to be operating in the same mode. So far, […] →Read more

How to measure QoS of GStreamer

Elements that synchronize buffers on the pipeline clock will usually measure the current QoS. They will also need to keep some statistics in order to generate the QOS event. 缓冲数据与管道时钟之间的同步通常可以用来衡量 QoS For each buffer that arrives in the sink, the element needs to calculate how late or how early it was. This is called the […] →Read more

TensorRT 训练后推理的利器

TensorRT is a large and flexible project. It can handle a variety of conversion and deployment workflows, and which workflow is best for you will depend on your specific use case and problem setting. TensorRT provides several options for deployment, but all workflows involve the conversion of your model to an optimized representation, which TensorRT […] →Read more

Deep Stream python app

refer to https://github.com/NVIDIA-AI-IOT/deepstream_python_apps →Read more

GStreamer tutorial 2

Goal The previous tutorial showed how to build a pipeline automatically. Now we are going to build a pipeline manually by instantiating each element and linking them all together. In the process, we will learn: What is a GStreamer element and how to create one. 什么是 GStreamer 元件,如何创建它 How to connect elements to each other. […] →Read more