Dummy HTTP source plugin

The Dummy HTTP source plugin (name: datagen, alias: dummy_http) generates simulated log data that you can use to test your pipeline configuration. This plugin is based on the Datagen source plugin and uses a predefined template to generate its logs.

Although this is a self-contained plugin that doesn’t communicate with external sources, it’s still classified as a pull-based source plugin.

This plugin doesn’t support the use of a descriptive metadata name in the Pipeline Builder interface.

Supported telemetry types

This plugin for Chronosphere Telemetry Pipeline supports these telemetry types:

Logs	Metrics	Traces

Configuration parameters

Use the parameters in this section to configure your plugin. The Telemetry Pipeline web interface uses the values in the Name column to describe the parameters. Items in the Key column are the YAML keys to use in pipeline configuration files.

Advanced

Name	Key	Description	Default
Memory Buffer Limit	`mem_buf_limit`	For pipelines with the Deployment or DaemonSet workload type only. Sets a limit for how much buffered data the plugin can write to memory, which affects backpressure. This value must follow Fluent Bit’s rules for unit sizes (opens in a new tab). If unspecified, no limit is enforced.	none

Template format

Logs generated by the Dummy HTTP source plugin use the following template format:

template: >-
        {
          "log": "{{ IPv4Address }} - {{ FirstName }} [{{ Day }}/{{ MonthString }}/{{ Number 2011 2024 }}:{{ Hour }}:{{ Minute }}:{{ Second }} -0700] \"{{ HTTPMethod }} {{ URLPath }} HTTP/{{ HTTPVersion }}\" {{ HTTPStatusCode }} {{ Number 100 10000 }} \"{{ URL }}\" \"{{ UserAgent }}\""
        }

This template produces logs that resemble the following examples:

[{"date":1733159068.797057,"log":"142.201.230.54 - Kitty [31/February/1938:14:22:50 -0700] \"HEAD /user-centric/open-source HTTP/HTTP/1.1\" 301 7907 \"https://www.principalunleash.name/magnetic/end-to-end/eyeballs\" \"Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10_8_5 rv:4.0; en-US) AppleWebKit/535.49.6 (KHTML, like Gecko) Version/6.2 Safari/535.49.6\""}]
[{"date":1733159069.797646,"log":"165.214.42.13 - Riley [8/July/1998:16:52:34 -0700] \"GET /enterprise/intuitive HTTP/HTTP/1.1\" 406 6981 \"https://www.productdot-com.com/enable/efficient/content/brand\" \"Mozilla/5.0 (iPad; CPU OS 8_0_3 like Mac OS X; en-US) AppleWebKit/534.13.6 (KHTML, like Gecko) Version/4.0.5 Mobile/8B113 Safari/6534.13.6\""}]
[{"date":1733159070.796631,"log":"13.114.140.228 - Bailey [1/February/1989:18:11:27 -0700] \"HEAD /distributed HTTP/HTTP/1.0\" 401 9871 \"https://www.internationalmorph.biz/24-365/global/action-items\" \"Mozilla/5.0 (iPad; CPU OS 7_3_3 like Mac OS X; en-US) AppleWebKit/532.14.2 (KHTML, like Gecko) Version/4.0.5 Mobile/8B119 Safari/6532.14.2\""}]
[{"date":1733159071.799888,"log":"72.109.188.94 - Fabiola [14/May/1987:0:43:25 -0700] \"DELETE /e-enable/virtual HTTP/HTTP/2.0\" 100 3605 \"https://www.internationalinnovative.com/bandwidth\" \"Opera/8.34 (Macintosh; U; PPC Mac OS X 10_6_7; en-US) Presto/2.12.268 Version/11.00\""}]
[{"date":1733159072.797658,"log":"19.32.161.243 - Marlene [23/March/1917:3:0:19 -0700] \"PATCH /global/deliverables HTTP/HTTP/1.1\" 205 6830 \"https://www.centralenable.info/e-business/vertical/models\" \"Mozilla/5.0 (Windows NT 5.0) AppleWebKit/5320 (KHTML, like Gecko) Chrome/38.0.815.0 Mobile Safari/5320\""}]
[{"date":1733159073.797684,"log":"40.66.86.63 - Leif [12/March/1904:6:28:31 -0700] \"POST /dot-com HTTP/HTTP/1.0\" 304 3638 \"http://www.humansexy.org/transparent\" \"Mozilla/5.0 (Windows NT 5.01; en-US; rv:1.9.2.20) Gecko/1915-02-18 Firefox/35.0\""}]
[{"date":1733159074.79653,"log":"196.27.18.191 - Shanny [10/January/1992:14:28:43 -0700] \"GET /systems/best-of-breed/incubate/enable HTTP/HTTP/2.0\" 403 1572 \"https://www.districtinitiatives.info/holistic/best-of-breed/integrated/24-7\" \"Mozilla/5.0 (Windows NT 6.0) AppleWebKit/5352 (KHTML, like Gecko) Chrome/37.0.888.0 Mobile Safari/5352\""}]
[{"date":1733159075.797568,"log":"154.13.34.48 - Neal [3/October/1931:22:16:42 -0700] \"GET /out-of-the-box/eyeballs/evolve/solutions HTTP/HTTP/1.1\" 200 7010 \"http://www.dynamicintegrate.io/incentivize/niches\" \"Mozilla/5.0 (Windows NT 6.0; en-US; rv:1.9.0.20) Gecko/1955-08-17 Firefox/36.0\""}]
[{"date":1733159076.796681,"log":"220.237.28.126 - Matteo [2/October/1903:10:42:10 -0700] \"HEAD /integrate/efficient HTTP/HTTP/2.0\" 406 2280 \"http://www.productdisintermediate.name/mission-critical/visionary\" \"Mozilla/5.0 (iPhone; CPU iPhone OS 8_1_2 like Mac OS X; en-US) AppleWebKit/536.51.1 (KHTML, like Gecko) Version/3.0.5 Mobile/8B111 Safari/6536.51.1\""}]
[{"date":1733159077.800555,"log":"113.30.237.225 - Abigayle [16/October/1925:10:32:6 -0700] \"DELETE /world-class/expedite/architectures HTTP/HTTP/1.0\" 504 1560 \"https://www.principale-services.io/strategize/deliverables\" \"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/5361 (KHTML, like Gecko) Chrome/40.0.884.0 Mobile Safari/5361\""}]

Dummy logs, metrics, and traces Elasticsearch HTTP