Context
NoFluffJobs is one of the Polish recruitment portals where employers meet, looking for new employees and employees looking for a new job in the world of broadly understood IT. Despite many similar portals in Poland, this is distinguished by the fact that each of the employers, in addition to the content of their advertisement, is required to define a number of structures for the information related to work, including range of salary, technologies, software, hardware, etc. This makes it a good place to look for a new job. work in Poland in the IT industry, especially by people with extensive experience and skills.
Content
The database contains a table with the current date for which all offers from the AI category on this page were downloaded. The table contains a total of 7 columns informing about: identification number, position title, whether it is a senior, expert or lead position, location, remuneration (most often given in the form of a scope) and the currency of the remuneration. The database will be updated in some time in the form of adding new tables with offers for the day the data was scrapped from the page.
Methodology
The data was obtained using webscraping. The Python language with the "BeautifulSoup", "requests", "re", "pandas" and "numpy" packages was used for this process and "SelectorGadet" add-on, which made the work with the site easier. The entire code was closed in a function with one parameter, which is a link to a page with filtered offers on AI
Photo by Christina @wocintechchat.com on Unsplash