We have been working and for those interested in observing and seeing how the process and architecture that we will be implementing in the development of our index here we leave the diagrams, which are stored in our cloud storage service and collaborative work Astian Cloud, , click here.

For this task we will use Guild.ai is not only open source, but it allows us to do all the cleaning process, automate the process and streamline the construction process becoming a key piece and fundamentally of the construction of our independent search engine AstianGO shortening years in development time.

• We will not show results and/or assists or aids using AI.
• We will not train any model with this, no, I repeat it will only be used to speed up the process of evaluating, ranking and rating the sites for our index.
• We will not use personal data, we will only evaluate, rank and rate the content of websites for subsequent inclusion in the index.
• No artificial intelligence models will be trained, it will only be used to rank and evaluate the thousands of websites.

As a measure to not depend on this functionality we will have our own crawler which will scan the web and the user can contribute to the expansion and construction of our index, how? manually sending the website to scan, example: A person Alfram search astian.org or youtube.com or facebook.com if AstianGO does not find anything, the same search engine will ask, Do you want to launch our crawler to the site you are looking for to index it? The user chooses whether to contribute or not voluntarily, our crawler will still pass by and capture the website.