Skip to content

Data generator

This service generates temperature data simulating one or more 3D printers. It simulates three temperature sensors on a fleet of 3D printers.

data generator pipeline segment

For each printer, the enclosure temperature is programmed to decrease starting at the 4 hour point. It will drop below the minimum threshold of 45Β°C at 5h:47m β€” the failure point.

The simulation speed is 10x actual spped, so the temperature will start to drop at approximately 24 minutes and cross the minimum threshold at around 34m 44s.

When printing with a heat-sensitive material such as ABS (Acrylonitrile Butadiene Styrene), it’s important to ensure that the temperatures remain stable.

The forecasting algorithm that attempts to estimate when this is going to happen, and displays the alert on a dashboard.

Data published

The generated data is published to the 3d-printer-data topic:

  • Ambient temperature
  • Ambient temperature with fluctuations
  • Bed temperature
  • Hot end temperature
  • original_timestamp
  • Printer finished printing

This service runs continually.

Exploring the message format

If you click Topics in the main left-hand navigation you see the topics in the environment. Click in the Data area to view live data. This takes you into the Quix data explorer. You can then select the stream and parameter data you'd like to explore. You can then view this data in either the Table or Messages view.

If you look at the messages in the Messages view, you'll see data has the following format:

{
  "Epoch": 0,
  "Timestamps": [
    1701277527000000000
  ],
  "NumericValues": {
    "hotend_temperature": [
      250.8167407832582
    ],
    "bed_temperature": [
      106.9299672495977
    ],
    "ambient_temperature": [
      36.92387946005222
    ],
    "fluctuated_ambient_temperature": [
      36.92387946005222
    ]
  },
  "StringValues": {
    "original_timestamp": [
      "2023-11-29 17:05:27"
    ]
  },
  "BinaryValues": {},
  "TagValues": {
    "printer": [
      "Printer 72"
    ]
  }
}

The Quix data explorer is a very useful tool for debugging and monitoring your pipeline.

Viewing the deployed application

In the left-hand main navigation, click Deployments to see all the deployed services and jobs in the environment. Click Data Generator to select the deployment. This takes you to an extremely useful screen where you can:

  1. View the status of the deployment (such as CPU, memory usage, and replicas assigned).
  2. See the live logs for the service.
  3. See the topic lineage for the service.
  4. Access Build logs (in case of errors when the service is built).
  5. Access the Messages tab, where you can then see messages associated with the service in real time.

Viewing the application code

There are many ways to view the code for the application (which is then deployed as a job or service). The quickest way from the current screen is to click the area shown:

Go to code view

You'll now be in the code view with the version of the deployed code displayed.

Review the code, you'll see that data is generated for each printer, and each printer has its own stream for generated data:

tasks = []
printer_data = generate_data()

# Distribute all printers over the data length
delay_seconds = int(os.environ['datalength']) / replay_speed / number_of_printers

for i in range(number_of_printers):
    # Set stream ID or leave parameters empty to get stream ID generated.
    name = f"Printer {i + 1}"  # We don't want a Printer 0, so start at 1

    # Start sending data, each printer will start with some delay after the previous one
    tasks.append(asyncio.create_task(generate_data_and_close_stream_async(topic_producer, name, printer_data.copy(), delay_seconds * i)))

await asyncio.gather(*tasks)

Feel free to explore the code further.

πŸƒβ€β™€οΈ Next step

Part 3 - Downsampling service