Skip to content
Assistance Needed w...
 
Notifications
Clear all

Assistance Needed with Text Parsing

10 Posts
2 Users
0 Reactions
4 Views
cory_ransom
(@cory_ransom)
Posts: 6
Active Member
Topic starter
 

I'm attempting to parse text from Telegram notifications, specifically trade alerts. I've included a sample alert below. My goal is to connect this to a webhook for my trading bot to execute trades. For some reason, I'm having trouble getting the text parsing module to function correctly. I've been using ChatGPT for guidance, but it hasn't yielded the desired results.

 
Posted : 18/05/2025 5:40 pm
samliew
(@samliew)
Posts: 293
Reputable Member
 

Welcome to the callin.io community!

If you're not the admin of the channel, you won't be able to connect a bot to it for receiving updates.

However, you can scrape the channel's webpage to retrieve the latest message.

See below for more details.


Essentially, you need to "visit" the site yourself to obtain the content. This process is known as Web Scraping.

Incomplete Scraping

Are you receiving NO output from the Text Parser's “HTML to Text” module? This is because there is NO text content within the HTML! The entire page content you are scraping is housed within a script tag, which is dynamically generated and inserted onto the page using JavaScript when it loads and executes in the user's web browser on the client-side. callin.io is a server-side runtime environment, so when using the HTTP modules, you only get the script tags. These script tags are ignored by the Text Parser “HTML to Text” module because they are NOT HTML layout elements.

Using callin.io's HTTP “Make a request” does NOT execute any of these JavaScript scripts, resulting in no content on the page except for a default message indicating that JavaScript needs to be enabled.

This is NOT an issue or bug with the callin.io platform, the Text Parser, or Regular Expressions.

You CANNOT use standard scraping integrations like ScrapingBee or the HTTP “Make a request” module to fetch this page's structure.

You will need to utilize ScrapeNinja's “Scrape (Real browser)” module to emulate a real user visiting the site via a web browser. This is necessary because client-side JavaScript must run to parse the JSON data within the script tags and generate the page structure and content.

For additional information and a demonstration using ScrapeNinja, please refer to Scraping Bee Integration Runtime Error 400

Web Scraping

For web scraping purposes, a service you can utilize is ScrapeNinja to extract content from web pages.

ScrapeNinja enables you to employ jQuery-like selectors to extract content from elements by using an extractor function. ScrapeNinja can also run the page within a real web browser, loading all content and executing page load scripts, thereby closely simulating your viewing experience, unlike the raw page HTML obtained from the HTTP module.

If you're looking for an example, please check out Grab data from page and url - #5 by samliew

AI-powered “easier” method

You can also leverage AI-powered web scraping tools such as Dumpling AI.

This is likely the most straightforward and rapid setup method, as it only requires you to describe the content you need, rather than inspecting elements to create selectors or devising regular expression patterns.

The advantage here is that such services consolidate both data fetching and extraction into a single module (saving operations) and eliminate the lengthy setup required by other methods.

More information, other methods

For more details on various web scraping techniques, see Overview of Different Web Scraping Techniques in Make 🌐

Hope this assists you! Please let me know if you have any further questions or encounter any issues. P.S.: Investing some time in the tutorials available in the callin.io Academy can significantly save you time and reduce frustration when using callin.io!

 
Posted : 19/05/2025 8:36 am
cory_ransom
(@cory_ransom)
Posts: 6
Active Member
Topic starter
 

ChatGPT provided me with this solution: FilterBox (Android app) – It filters messages containing keywords such as “bingx” or “bitunix” and forwards them via webhook to callin.io.

I'm currently leveraging my notifications to circumvent the need for admin privileges. This setup functions perfectly until I attempt to parse specific information.

 
Posted : 19/05/2025 6:48 pm
samliew
(@samliew)
Posts: 293
Reputable Member
 

You have not yet provided sufficient information about your scenario to demonstrate the problem that would allow us to reproduce the scenario and any error(s).

To allow others to assist you with your scenario, please provide the following:

1. Relevant Screenshots

Could you please share screenshots of your full scenario? Also include screenshots of any error messages, module settings (fields), relevant filter settings (conditions), and module output bundles. We need to see what you’re working with to give you the best advice.

You can upload images here using the Upload icon in the text editor:

We would appreciate it if you could upload screenshots here instead of linking to them outside of the forum. This allows us to zoom in on the image when clicked, and prevent tracking cookies from third-party websites.

2. Scenario Blueprint

Please export the scenario blueprint. Providing your scenario blueprint file will allow others to quickly recreate and see how you have set up the mappings in each module, and also allows us take screenshots or provide module exports of any solutions we have for you in return - this would greatly benefit you in implementing our suggestions as you can simply paste module exports back into your scenario editor!

To export your scenario blueprint, click the three dots at the bottom of the editor then choose ‘Export Blueprint’.

You can upload the file here by clicking on this button:

3. Output Bundles of Modules

Please provide the output bundles of each of the relevant modules by running the scenario (you can also get this without re-running your scenario from the History tab).

Click on the white speech bubbles on the top-right of each module and select “Download input/output bundles”.

A. Upload as a Text File

Save each bundle contents in a plain text editor (without formatting) as a bundle.txt file.

You can upload the file here by clicking on this button:

B. Insert as Formatted Code Block

If you are unable to upload files on this forum, alternatively you can paste the formatted bundles.
These are the two ways to format text so that it won’t be modified by the forum:

  • Method 1: Type code block manually

    Add three backticks ``` before and after the content/bundle, like this:

    ```
    content goes here
    ```

  • Method 2. Highlight and click the format button in the editor

Providing the input/output bundles will allow others to replicate what is going on in the scenario, especially if there are complex data structures (nested arrays and collections) or if external services are involved, and help you with mapping the raw property names from collections.

Sharing these details will make it easier for others to assist you.

 
Posted : 20/05/2025 10:43 am
cory_ransom
(@cory_ransom)
Posts: 6
Active Member
Topic starter
 

![[Screenshot20250511181615_FilterBox|230x500]](

blueprint.json (13.3 KB)

bundle.txt (400 Bytes)

ChatGPT keeps suggesting I map using dropdowns that aren't present or click on puzzle pieces to input information. Some fields remain empty because I'm unsure where to put the data. Thanks for your help and patience.

 
Posted : 21/05/2025 5:06 pm
cory_ransom
(@cory_ransom)
Posts: 6
Active Member
Topic starter
 

This is what I'm currently using to receive Telegram notifications on my phone.

 
Posted : 21/05/2025 5:09 pm
samliew
(@samliew)
Posts: 293
Reputable Member
 

First, configure this setting to 'no'. This ensures that if no matches are found, subsequent modules will not proceed.

Screenshot 2025-05-22 114021

Next, I require the output bundle from the Webhook trigger module, which you have not yet supplied.

 
Posted : 22/05/2025 3:41 am
cory_ransom
(@cory_ransom)
Posts: 6
Active Member
Topic starter
 

ChatGPT was insistent that it be sent to yes, not as easy a process as I would have liked. haha I’m adjusting my filter and will upload the output over the next day or so. Thanks again for the help.

 
Posted : 23/05/2025 1:20 am
cory_ransom
(@cory_ransom)
Posts: 6
Active Member
Topic starter
 

I believe this is the information you were looking for. Please let me know if I've misunderstood.

 
Posted : 23/05/2025 2:39 am
samliew
(@samliew)
Posts: 293
Reputable Member
 

The output bundle does not appear to contain any actionable information. It's advisable to review the configuration of the service responsible for sending data to the webhook to ensure correct data transmission.

Hope this assists! Please reach out if you encounter any further questions or challenges. P.S.: Dedicating some time to the tutorials available in the callin.io Academy can significantly reduce the time and effort required when using callin.io!

 
Posted : 23/05/2025 5:41 am
Share: