How Parseable Enhances Log Observability on Kubernetes
Logs are vital to the smooth functioning of modern software applications. As containerized environments grow in complexity, managing vast volumes of log data becomes an ever-greater challenge. In this article, we explore how Parseable log observability offers a simple yet powerful solution for efficiently storing and querying logs in Kubernetes environments.
The Need for Robust Log Observability
As businesses scale, the sheer volume of log data increases exponentially. SREs, DevOps engineers, and developers need an effective way to analyze logs to maintain application health and resolve issues quickly. Traditional logging systems often fall short, especially in cloud-native environments like Kubernetes.
Parseable log observability provides a modern, cloud-native solution that allows teams to store, query, and analyze log data efficiently. It bridges the gap between OLAP (Online Analytical Processing) systems and traditional log storage platforms by offering features that enable real-time alerts, data correlation, and deep-dive incident analysis.
Parseable: The Ideal Log Observability Platform
Parseable is designed with the developer in mind. The platform provides a Kubernetes-native experience, ensuring seamless integration and deployment. Its OLAP-like architecture allows for scalable storage, but it functions as a dedicated log observability platform with enhanced features.
Key features of Parseable log observability include:
- Ownership of data: Ensure complete control over your logs and data.
- Simplicity: Parseable is easy to deploy, maintain, and scale in Kubernetes environments.
- Kubernetes-native: Seamlessly integrate with containerized workflows.
- Scalable storage: Leverage an architecture built for large volumes of logs without compromising performance.
With Parseable, teams can avoid the complexities of traditional log storage platforms while gaining the robust features needed for operational efficiency.
Getting Started with Parseable on Kubernetes
Setting up Parseable log observability on Kubernetes is simple and efficient. Here’s a step-by-step guide to get you started quickly:
Prerequisites
- S3 or compatible storage buckets.
kubectlandhelminstalled on your machine.
Install Parseable with Helm
Start by adding the Parseable Helm chart repository:
helm repo add parseable https://charts.parseable.io/
kubectl create namespace parseable
helm install parseable parseable/parseable --namespace parseable --set parseable.demo=true
This command installs Parseable in demo mode, which uses a publicly hosted bucket for testing. To configure Parseable with your own storage, refer to the configuration section below.
Access the GUI
After installation, expose the Parseable service locally:
kubectl port-forward svc/parseable -n parseable 8000:80
Now, navigate to http://localhost:8000 in your browser to access the Parseable login page. In demo mode, the default login credentials are parseable for both username and password.
Sending and Querying Logs
Once logged in, you can start sending log data to your Parseable instance. First, create a log stream using the following command (replace <stream-name> with your desired name):
curl --location --request PUT 'http://localhost:8000/api/v1/logstream/<stream-name>' \
--header 'Authorization: Basic cGFyc2VhYmxlOnBhcnNlYWJsZQ=='
Next, send your log data to this stream:
curl --location --request POST 'http://localhost:8000/api/v1/logstream/<stream-name>' \
--header 'X-P-META-meta1: value1' \
--header 'X-P-TAG-tag1: value1' \
--header 'Authorization: Basic cGFyc2VhYmxlOnBhcnNlYWJsZQ==' \
--header 'Content-Type: application/json' \
--data-raw '[ { "id": "434a5f5e-2f5f-11ed-a261-0242ac120002", "datetime": "24/Jun/2022:14:12:15 +0000", "host": "153.10.110.81", "user-identifier": "Mozilla/5.0 Gecko/20100101 Firefox/64.0", "method": "PUT", "status": 500, "referrer": "http://www.google.com/" }]'
Once the data is sent, switch to the Parseable dashboard in your browser to see your logs. You can also use the Query API to run SQL-like queries on your log data directly.
Configuration Options
To configure Parseable with your own storage solution, set the necessary S3 environment variables via Helm or modify the values.yaml file. Here’s an example of the required configuration:
P_S3_URL=https://s3.us-east-1.amazonaws.com
P_S3_ACCESS_KEY=<access-key>
P_S3_SECRET_KEY=<secret-key>
P_S3_REGION=<region>
P_S3_BUCKET=<bucket-name>
P_USERNAME=<username-for-parseable-login>
P_PASSWORD=<password-for-parseable-login>
For more detailed configuration, refer to the Parseable documentation.
Optimize Your Operations with ZippyOPS
While Parseable offers incredible log observability, integrating it with broader operations management is key for seamless workflows. ZippyOPS provides consulting, implementation, and managed services for DevOps, DevSecOps, Cloud, Automated Ops, Microservices, Infrastructure, and Security. If you’re looking to enhance your DevOps pipeline, ZippyOPS can help streamline your processes and ensure robust security at every step.
Discover how ZippyOPS can transform your operations:
For more information, or to schedule a consultation, reach out to ZippyOPS at sales@zippyops.com.
Conclusion for Parseable log observability
Parseable log observability offers a simple yet powerful solution for managing and querying logs in Kubernetes environments. With its Kubernetes-native approach and scalable log storage capabilities, Parseable empowers teams to gain actionable insights from their logs. By seamlessly integrating Parseable with ZippyOPS services, you can further enhance your DevOps practices, optimize your infrastructure, and ensure your operations remain smooth and secure.
