One Product, One Post: Dedupe Overlapping Telegram Deal Sources

When several Telegram deal sources feed one channel, the same product can arrive three times in an afternoon: once as a short link, once with a different price format, once after a price cut. RedFox Auto Forward Telegram’s Duplicate Filters can check every candidate against what your target channel has already published, then skip the repeat. Choose Match by target chat, pick the detection method that matches how your sources repeat themselves, and set a memory window that fits your deal cycle.

The result is one post per product for your readers, without manually deleting copies after they land. You stay in control of the important editorial question: is a lower price on the same product news, or noise?

This guide covers RedFox Auto Forward Telegram (@AutoForwardNew_Bot). RedFox develops the product; Auto-Bot.io publishes this guide. The official Duplicate Filters page covers the basic setup. The method details below reflect RedFox’s current Duplicate Filters setting descriptions and matching rules, checked November 6, 2026.

Why a multi-source deal channel repeats itself

Deal channels rarely copy each other word for word. One source shortens the Amazon link, another posts the full product URL with its own tag, a third adds “Buy now” or rewrites the price as Rs. 12499 instead of ₹12,499. Each post is technically different, yet your subscribers see the same monitor again.

A check that only compares posts within one source cannot catch that. The repetition happens where the sources meet: in your target channel. That is why this workflow depends on target matching rather than on separate per-source checks.

Before changing any setting, confirm that the extra copies really come from different source posts. If one source message reaches the same target twice, you probably have overlapping tasks or targets. Start with the duplicate-message diagnosis guide instead, because a content filter should not hide a route mistake.

Choose the detection method by how your sources repeat

Open the task’s ♻️ Duplicate Filters screen in the bot. It offers four detection methods. Existing tasks keep identical-content detection until you choose another one.

• Identical content. Skips a post whose text matches a remembered post exactly; for media without a caption, it compares the media file. Choose it when sources repost unchanged messages, such as a mirrored announcement.
• Similar content. Ignores superficial differences: letter case, formatting, invisible characters, rupee price notation such as ₹12,499 versus Rs. 12499, one swapped promotional word such as “today” for “now”, or an added or removed tag such as “Buy now”, “Shop now”, “Limited offer” or “On sale”. It keeps posts whose numbers or compared link identities differ, so a new price, size or model number still gets through. Amazon links to the same marketplace and product code count as the same link even when the short URL or affiliate tag differs; other links must match exactly. Very short posts are only matched when identical.
• Same Amazon product. Treats a post as a repeat when its Amazon product was already published within the memory window, even if the price, wording or affiliate tag changed. Supported Amazon short links are followed to the product first. Posts without an Amazon product link are never dropped by this method.
• Combined (product first). Uses the Amazon product rule when a post contains an Amazon product, and the Similar content rules for everything else. Choose it for a feed that mixes Amazon deals with other announcements.

Two safety rules make the product methods practical for real deal feeds. A post containing any product that has not been published yet, or a link that could not be resolved, is treated as new rather than dropped. A multi-product post or album is skipped only when one earlier published post contained every Amazon product in it—not merely when those products appeared separately. A product is identified by its Amazon marketplace and product code, so the same item on amazon.in and amazon.com counts as two products.

The same caution applies to other links. The product methods only skip a post when every link in it is a recognized Amazon product. A channel invite or non-Amazon store link makes it count as new, whether that link comes from the source or your task’s own added header or footer. Under Similar content, Amazon links are compared by product identity, while other links must match exactly. Rehearse with the complete outgoing post, including your own branding links, before assuming repeats will be caught.

Decide whether a price drop deserves another post

This is the choice that matters most for a deal channel:

• Price cuts are news for your readers: choose Similar content. A near-identical repeat with the same price is skipped; a different price or a substantially rewritten post is treated as new.
• One post per product per window is cleaner: choose Same Amazon product, or Combined if non-Amazon posts share the feed. Later price changes for that product are skipped, not queued. A fresh post after its remembered publication expires can pass as new; skipped posts are not automatically reposted.

Write the decision down before you configure it. Otherwise a missing price-drop post can look like a delivery failure when the filter did exactly what it was told.

Walk one product through three sources

Consider a home-office deals channel in India that you run, fed by three deal sources you are permitted to republish. Each source has a task into the same target channel. On one day these posts arrive for the same fictional product, with two other posts mixed in:

1. 10:02, Source A: “ErgoView 27-inch IPS monitor with height-adjustable stand drops to ₹12,499 today” with an amzn.to short link.
2. 10:05, Source B: the same sentence ending in “now” instead of “today”, priced as Rs. 12499, with a full amazon.in product link carrying another affiliate tag.
3. 13:40, Source C: “ErgoView 27-inch monitor price cut: ₹11,999 on Amazon” with a link to the same product.
4. 14:10, Source A: a different product, a mechanical keyboard.
5. 15:30, Source B: a store-wide sale announcement with no Amazon product link.

Under the current rules, the outcomes differ by method:

• Same Amazon product: post 1 is published. Posts 2 and 3 are skipped because the monitor was already published. Posts 4 and 5 are published.
• Combined (product first): same as above for posts 1–4. Post 5 has no Amazon product, so it is compared using the Similar content rules and is published as a new announcement.
• Similar content: post 1 is published and post 2 is skipped, because only the promotional word and the price notation changed. Post 3 is published because its price is different. Posts 4 and 5 are published.
• Identical content: every post is published, because none of them is an exact repeat.

The worked example shows how the current rules apply, not a recorded test from a live channel. It also assumes no other links in these posts and that all three tasks use the same method. Rehearse it with your own sources before relying on it.

Set scope, memory and limits

1. Turn Duplicate Filters on for the task and choose the method you decided on above. Switching the filter on fills in a starting configuration: a seven-day memory, a 50-message limit, and both source and target matching on. Switching it off and on again restores those starting values, so re-check your settings afterward.
2. Confirm Match by target chat is on. The bot explains it plainly: source checks apply per source, while target checks detect duplicates from multiple sources sending to the same target. Choosing a method does not change these switches or the interval.
3. Match by source chat can stay on, but this workflow does not depend on it. It checks repeats within a source; availability depends on your plan. This cross-source workflow relies on target matching.
4. Match by message token is not part of this workflow. The target-matching result described here does not depend on it, so leave it as it is unless you already use it for another purpose.
5. Set Message memory duration in seconds. The starting value is 604,800 seconds, which is seven days. For a daily deal channel, 86,400 (24 hours) or 259,200 (72 hours) is often a more natural window. A longer window remembers more history and can slow forwarding, so choose the shortest window that still matches your repost pattern.
6. Set the count field. With Identical content it is the Exact-mode message limit: how many recent messages are remembered, so a limit of 1 only catches a repeat of the most recent post. With the other methods it becomes Duplicate checks: any value above 0 turns checking on, and history is kept for the memory duration instead of a message count. A value of 0 turns duplicate filtering off in both cases.
7. Choose “Restart to apply”. With Similar, Same Amazon product or Combined selected, the screen shows a 🔄 Restart to apply button and explains that saving the selection alone does not confirm the method is active. Use it before you first rely on a new method. Plan for active tasks to pause during the restart; RedFox’s Profile Settings guide asks you to allow 5–10 minutes.

If each source has its own task into the same target, give every one of those tasks the same method and window. Target history is compared per target and per method, so a task left on a different method will not see what its siblings already published.

Duplicate Filters is a paid-plan task setting, listed from the Gold package upward. The Free plan covers basic routes. Check your current plan in the bot or app before planning around a specific switch.

Rehearse with a test channel before going live

Use a test source and a private target channel that you control, plus harmless sample posts. Keep the live channel untouched until the rehearsal agrees with your written decision.

1. Configure the test task with the same method, target matching and memory window you plan to use, then restart to apply.
2. Post a baseline deal with an Amazon product link. Confirm it reaches the target.
3. Post the repeat variant your sources actually produce: a short link, a reworded promotional word or a different price format. Confirm whether it is skipped, as your method predicts.
4. Post a price-change variant and confirm it follows your price-drop decision.
5. Post a genuinely different product as your control. If the control does not arrive, stop and investigate before changing more settings.

Use a different test product for each rehearsal round, or a fresh test target; new wording alone does not escape a product-based memory. Reducing the memory setting does not shorten entries already remembered. Change one setting at a time. If the repeat still appears, check whether its link really points to the same product and marketplace, whether a source or your task’s header/footer adds another link, and whether every task feeding the target uses the same method.

Two behaviors help during busy hours. A copy that definitely failed to publish does not block a later copy of the same deal. If two sources deliver the same product moments apart, the second waits briefly for the first to finish, then is skipped if the first was published. When the duplicate history cannot be checked, the newer methods hold the post for a short retry rather than risk a double post, so an unusually long memory window on a very busy channel can delay delivery.

What the filter will not decide for you

• It does not judge story meaning. Similar content is intentionally conservative. Two outlets reporting the same news in different words are usually treated as different posts. If you need a narrower feed, combine Duplicate Filters with keyword rules or the Forwards type filter described in the skip-forwarded-reposts guide.
• It does not repair source edits. A corrected source post that arrives as a new message is an Edit setting question, covered in edits that arrive as new messages.
• It does not inspect links for you. To show readers where a short link leads, see the Final Redirect Link guide. Affiliate link conversion is a separate feature, described in the affiliate conversion guide.
• It does not change program rules or content rights. Affiliate programs set their own conditions for where and how links may be shared; check your program’s current terms. Forward only sources you are allowed to republish.
• It is not for history copies. A Clone run is a separate operation; do not rely on a regular task’s duplicate filter to make rerunning a Clone into the same target harmless.

Keep a short private note with the task so the next operator understands the decision:

Target: home-office deals channel
Tasks: Source A, Source B, Source C (one task each)
Method: Same Amazon product (all three tasks)
Match by target chat: on
Memory duration: 259200 seconds (72 hours)
Price drops within the window: skipped, not reposted later
Restart to apply: done, then rehearsed
Next review: after the first week of live posts

Questions before you turn it on

Does this help with Flipkart or other non-Amazon deals?

The product-based method recognizes Amazon product links. For other stores, use Similar content or Combined: posts are then compared by their normalized text, numbers and links, so a repost with the same wording and the same link is caught, while a changed price or a different non-Amazon link, including its affiliate tag, is treated as new. Amazon product links are the exception: their marketplace and product code determine link identity.

Can I use it for a news channel that follows many outlets?

Yes, for repeats that are identical or only superficially different. Choose Identical content or Similar content with target matching. Do not expect it to merge differently written reports of the same event.

Will my existing tasks change automatically?

No. Existing tasks keep identical-content detection until you choose another method, and the new methods should be applied with a restart before you rely on them.

A deal I expected is missing. Is the filter to blame?

Check the decision first. Under Same Amazon product, a price-change post is skipped while that product is remembered, not held for later publication. If a genuinely new product is missing, compare it with the rehearsal control, confirm the task’s other filters, and only then contact RedFox support with the source, target, method and approximate time.

Give your readers one post per deal

Explore RedFox Auto Forward Telegram, then set Duplicate Filters on the tasks that feed your deal channel. Start with target matching, one written price-drop decision and a short rehearsal in a test channel. For the wider picture of routes, filters and plans, see the Telegram message automation guide.

Choose the Web app, iOS app or Android app, whichever suits you; Web and mobile offer fuller task management than the Telegram-bot entrypoint, and the bot’s task settings contain the Duplicate Filters screen described here. Active tasks run in RedFox’s cloud without keeping the interface open. RedFox reports 99.99% service uptime; that is a service metric, not a measure of duplicate-detection accuracy.