Slack fixes AI security glitch

Update: Slack has released an update, stating that they have “deployed a patch to address the reported issue” and assuring that there is currently no evidence to suggest that customer data have been accessed without authorization. Here is the official statement from Slack that was posted on their blog:

When we became aware of the report, we immediately initiated an investigation into the described scenario where, under very limited and specific circumstances, a malicious actor with an existing account in the same Slack workspace could attempt to phish users for certain data. We have promptly deployed a patch to tackle the issue, and at present, we have no evidence of unauthorized access to customer data.

Below is the original article that was initially published.

Recommended Videos

When ChatGTP was integrated into Slack, the intention was to make users’ lives more convenient by summarizing conversations, drafting quick replies, and more. However, according to the security firm PromptArmor, attempting to carry out these tasks and more could potentially breach your private conversations through a method known as “prompt injection.”

The security firm warns that by summarizing conversations, it can also gain access to private direct messages and deceive other Slack users into engaging in phishing activities. Additionally, Slack allows users to request the retrieval of data from private and public channels, even if the user is not a part of those channels. What is even more concerning is that the attack can function without the Slack user being present in the relevant channel.

In theory, the attack commences when a Slack user manages to trick the Slack AI into disclosing a private API key by creating a public Slack channel with a malicious prompt. The newly created prompt instructs the AI to replace the word “confetti” with the API key and send it to a specific URL when someone requests it.

The situation has two aspects: Slack has updated the AI system to scrape data from file uploads and direct messages. The second is a technique called “prompt injection,” which PromptArmor has demonstrated can create malicious links that are likely to deceive users.

This technique has the ability to deceive the app into bypassing its normal restrictions by modifying its core instructions. As a result, PromptArmor states, “Prompt injection occurs because a [large language model] is unable to distinguish between the’system prompt’ created by a developer and the rest of the context appended to the query. Therefore, if Slack AI ingests any instruction through a message, and if that instruction is malicious, there is a high likelihood that the Slack AI will follow that instruction instead of, or in addition to, the user query.”

To make matters worse, the user’s files also become targets, and the attacker who desires the user’s files does not even need to be present in the Slack Workspace to begin with.

  • mayask

    Related Posts

    ChatGPT’s new Canvas feature like Claude’s Artifacts vividly

    img { max-width: 100%; } OpenAI Following closely on the heels of its whopping $6.6 billion funding round, OpenAI on Thursday made the beta of a brand-new collaboration interface for…

    OpenAI raises $6.6B in latest funding round

    Andrew Martonik / Digital Trends OpenAI has now emerged as one of the wealthiest private companies on Earth after successfully securing a whopping $6.6 billion in its latest funding round…

    You Missed

    New Avatar: The Last Airbender game looks super ambitious

    • By mvayask
    • October 5, 2024
    • 41 views

    PS5 colorful chrome accessories pre-order now

    • By mvayask
    • October 5, 2024
    • 39 views
    PS5 colorful chrome accessories pre-order now

    ChatGPT’s new Canvas feature like Claude’s Artifacts vividly

    • By mayask
    • October 5, 2024
    • 40 views
    ChatGPT’s new Canvas feature like Claude’s Artifacts vividly

    OpenAI raises $6.6B in latest funding round

    • By mayask
    • October 5, 2024
    • 45 views
    OpenAI raises $6.6B in latest funding round

    Qualcomm aims to add cool AI tools to Android phone

    • By mayask
    • October 5, 2024
    • 40 views
    Qualcomm aims to add cool AI tools to Android phone

    Reddit in $60M deal with Google for AI tools boost

    • By mayask
    • October 5, 2024
    • 39 views