Let's talk about building your own search engine from scratch from the beginner's perspective.
Recently I built a search engine from scratch. Yes, I didn't use code from any existing repository or YouTube video. I created a bot that goes to every website and scrapes data from there, stores the data in the database, and I can search the query from a MERN application with an accessible user interface. And it returns results in both text format and in image format.
And in this video, I have shared my personal experience of making a brand-new search engine. The tools required, the languages you can choose, the project division, etc.
Timestamp:
00:00 - Introduction
00:19 - How Google Works
00:51 - Three Stages of Search Engine
02:24 - Crawling
07:52 - Parsing
12:56 - Indexing
15:21 - Tools Required
17:48 - An Example
21:43 - Resources
22:08 - Contribute
22:20 - Outro
Tools required
Database (Redis, MongoDB)
Frontend (React, Vue)
Backend (Express, Django)
Scraping Library (Puppeteer, Selenium)
You can use any language you prefer but it must be capable to handle all of these operations. Give priorities to javascript or python.
Links to the resources discussed in the video:
Slides: https://slides.com/aashishpanthi-1/co...
Article: https://blog.aashish-panthi.com.np/cr...
Search engine (Source code): https://github.com/aashishpanthi/sear...
Crawler (Source code): https://github.com/aashishpanthi/web-...
My search engine (if not down): https://www.juhu.live
How Google Works (By google): https://developers.google.com/search/...
WORTH CHECKING:-
Hosting websites for free(playlist):
• Free Web Hosting
Making Facebook Clone using HTML & CSS:
• How to create a website like Facebook...
Send EMAIL without backend (using HTML):
• How to send email using HTML only wit...
Top 5 online CODE editors:
• Top 5 Free Online Code Editors, cloud...
AROUND THE WEB:
GitHub: @aashishpanthi
https://www.github.com/aashishpanthi
Instagram: @aashishpanthi11
/ aashishpanthi11
Dev.to: @aashishpanthi
https://dev.to/aashishpanthi
Do not click this 🥴: https://bit.ly/352wEsG
-------------------------------------------------------------------------------------
Appreciate:
Images from unsplash:: https://unsplash.com
Free video from pixaby:: https://pixabay.com
Free video from pikbest:: https://pikbest.com
Free video from pexels:: https://pexels.com
Free stocks from mixkit:: https://mixkit.co
Illustrations from undraw:: https://undraw.co/illustrations
Free stuffs from flaticon :: https://www.flaticon.com/
Hey there lovely people, this channel is about WEB DEVELOPMENT && PROGRAMMING. Here, I upload videos once in every uncertain time 😜. Mainly, videos are related to tutorials and informative videos.
#code
Смотрите видео Make your own Search Engine from Scratch like Google, Bing || Javascript, Python онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Kode 01 Январь 1970, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 4,760 раз и оно понравилось 71 людям.