Kafka ?? ?? ? ??? ????? ?? ??? ?? ????? ???? ????? ?? ?????. ???? ???? ???? ??? ???? ???? ???? Kafka ?? ??? ??? ?? ?? ??? ????? ?? ???. ? ?????? JavaScript ? GitHub Actions? ???? ? ????? ????? DevOps ????? ???? ???? ??? ?????.

?? Kafka ?? ??? ??

Kafka ??? ??? ??? ?????. ????? ???? ?? ??? ?? ??? ??? ???? ???.

• ??? ??? ?? ??
• ???? ??? ?? ?? ??
• ??? ??? ?? ??

???? ???? ?? ?? ?? ??? ????? ??? ???? ????. ??? ??? ????? ??? ??? ??? ? ???, ? ??(??, ??, ????)?? ???? ??? ?? ??? ?????. ???? ??? ??? ?? ????? ?? ?? ??? ???? ?? ??? ?????.

?? ?? ???? ??

Kafka ?? ?? ? ?? ???? ??? ?? ??? ??? ?????.

1. ?? ???? ??? ?? ??.
2. ?? ?? ? ?? ??? ??????.
3. ?? ??? ?? ?? ??.
4. ???? DevOps ????.
5. ?? ?? ??? CI/CD ?????? ?????.

??? ?? ??

? ????? ??? ????? JavaScript? ?????. ?? ??? ????? JavaScript? ??? ?? ??? ?????.

• Bash?? ????? ? ?????.
• ?? ?? JavaScript ?? ??? ?????.
• npm? ?? ??? ??? ???
• Kafka ??? ?? ???/?? ??? ?????.

? ???? Kubernetes ???? ???? Node.js ???????? ????, VPC ??? ?? Kafka ????? ???? ?? ??????.

?????? ??

Node.js ????? ?????. npm init -y? ???? ??? ????. Node.js? npm? ???? ?? ?? ?? http://m.miracleart.cn/link/0d78f6439e652fdbf801d103430d2e12

???? ?????? npm install kafkajs? ???? Kafka JavaScript ?????? ?????.

??? ??

??? ???? ? ?? ?? ?? ??? ?????.

1. ????? ??? ??? ???? JSON ?? ?????.
2. Kafka? ?????? ??? ??? ???? Node.js ?????????.
3. JSON ?? ?? ?? ? ???? ????? GitHub Actions ????

? ?? ??? ??? ?????.

?? ?? ??

??????? ????? ??? ??? ??? JSON ??? ????. ?? ?? GitHub ? ??? ?? ?? ?? ??? ??????. PR? ??? ? ??? ????? ??? ?? ?? ?? ??? ??/?????.

??? topics.json:

{
  "create": [],
  "delete": []
}

? ??? ?? ?? ??? ?? ?? ?? ??? ?????. create ???? ??? ??? ????, delete?? ??? ??? ?????.

?? ?? API ??

??? api.js:

async function createTopics(topics, kafkaAdmin) {
  if (topics.length > 0) {
    await kafkaAdmin.createTopics({
      topics: topics.map((topic) => ({
        topic,
        numPartitions: 1,        // Adjust as needed
        replicationFactor: 3,    // Adjust as needed
        configEntries: [
          { name: "min.insync.replicas", value: "2" }  // Adjust as needed
        ],
      })),
    });
  }
}

async function deleteTopics(topics, kafkaAdmin) {
  if (topics.length > 0) {
    await kafkaAdmin.deleteTopics({ topics: topics });
  }
}

module.exports = { createTopics, deleteTopics };

? ??? Kafka ??? ???? ???? ??? ?????. ??? ?? ?? ?(???, ?? ??, min.insync.replicas)? ?????.

?? ?????? ??

??? index.js:

const { Kafka } = require("kafkajs");
const { createTopics, deleteTopics } = require("./api");
const topics = require("../topics.json");

// ... (Kafka connection details using environment variables) ...

const kafka = new Kafka({
  // ... (Kafka connection configuration) ...
});

const admin = kafka.admin();

admin.connect().then(async () => {
  const existingTopics = await admin.listTopics();

  // Create only non-existent topics
  const newTopics = topics.create.filter((x) => !existingTopics.includes(x));
  await createTopics(newTopics, admin);

  // Delete only existing topics
  const deletionTopics = topics.delete.filter((x) => existingTopics.includes(x));
  await deleteTopics(deletionTopics, admin);

  await admin.disconnect();
});

? ??????? Kafka ??? ????, ?? ??? ??, ?? ??/??? ?????. ?? ??? ?? ?? ??? ???? ??? ??? ?? ??? ?????.

GitHub Actions? ?? ???

GitHub Actions? ???? ?? ?? ??????? CI/CD ?????? ?????. ?? ?? ??? ??? ??? ??? ??????.

?? .github/workflows/kafka.yml:

# ... (GitHub Actions workflow YAML configuration -  This section needs significant adaptation for a real-world scenario and would require setting up AWS credentials, ECR, and Kubernetes cluster details. The provided example is incomplete and illustrative only.) ...

? ????? ??, ?????(Docker ??), ???? ?????(?: Amazon ECR)? ??, ???? Kubernetes? ??? ??????.

??

? ?????? JavaScript ? GitHub Actions? ???? Kafka ?? ?? ? ??? ????? ??? ?????. JSON ?? ??? GitHub Actions? ???? ? ?? ??? ???? ???? ?? Kafka ??? ???? ?? ?? ??? ???? ?????. ?? ??? CI/CD ?????? ???? Kafka ?? ???? ???? ???? ?? ??? ?????. ?? ?? ?? ?? ??? ?? DevOps ??? ?? ????? ???? ????? ?????. ??? ??? ?? ?? ??? ?? ??? ?? ? ??? ?? ?? ??? ???.

? ??? GitHub Actions ? JavaScript? ???? Kafka ?? ?? ? ??? ????? ??? ?? ?????. ??? ??? PHP ??? ????? ?? ?? ??? ?????!