This document describes how to create NetworkChaos experiments in Chaos Mesh.
NetworkChaos actions are divided into two categories:
Network Partition action separates pods into several independent subnets by blocking communication between them.
Network Emulation (Netem) Chaos actions cover regular network faults, such as network delay, duplication, loss, and corruption.
Network Partition Action
Below is a sample network partition configuration file:
For more sample files, see examples. You can edit them as needed.
- action defines the specific chaos action for the pod. In this case, it is network partition.
- mode defines the mode to run chaos action.
- selector specifies the target pods for chaos injection. For more details, see Define the Scope of Chaos Experiment.
- direction specifies the partition direction. Supported directions are
- target specifies the target for network partition.
- duration defines the duration for each chaos experiment. In the sample file above, the network partition lasts for
- scheduler defines the scheduler rules for the running time of the chaos experiment. For more rule information, see robfig/cron.
Netem Chaos Actions
There are 4 cases for netem chaos actions, namely loss, delay, duplicate, and corrupt.
The detailed description of each field in the configuration template are consistent with that in Network Partition.
A Network Loss action causes network packets to drop randomly. To add a Network Loss action, locate and edit the corresponding template in /examples.
In this case, two action specific attributes are required - loss and correlation.
loss defines the percentage of packet loss.
NetworkChaos variation is not purely random, so to emulate that there is a correlation value as well.
A Network Delay action causes delays in message sending. To add a Network Delay action, locate and edit the corresponding template in /examples.
In this case, three action specific attributes are required - correlation, jitter, and latency.
latency defines the delay time in sending packets.
jitter specifies the jitter of the delay time. Default is
correlation specifies the correlation of the jitter. Default is
In the above example, the network latency is 90ms ± 90ms with 25% correlation.
A Network Duplicate action causes packet duplication. To add a Network Duplicate action, locate and edit the corresponding template in /examples.
In this case, two attributes are required - correlation and duplicate.
duplicate indicates the percentage of packet duplication. In the above example, the duplication rate is 40%.
A Network Corrupt action causes packet corruption. To add a Network Corrupt action, locate and edit the corresponding template in /examples.
In this case, two action specific attributes are required - correlation and corrupt.
corrupt specifies the percentage of packet corruption.
Network Bandwidth Action
Network Bandwidth Action is used to limit the network bandwidth. To add a Network Bandwidth Action, locate and edit the corresponding template in /examples.
Minikube does not support this feature as
CONFIG_NET_SCH_TBFis disabled in Minikube's image.
To inject Network Bandwidth fault, three action specific attributes are required - rate, buffer and limit.
rate allows "bps", "kbps", "mbps", "gbps", "tbps" unit. "bps" means bytes per second.
limit defines the number of bytes that can be queued waiting for tokens to become available.
buffer is the maximum amount of bytes that tokens can be available for instantaneously.
peakrate is the maximum depletion rate of the bucket.
minburst specifies the size of the peakrate bucket.