目標（我需要反復搜索數百次）：1. 在“https://www.ncbi.nlm.nih.gov/ipg/”中搜索（例如“WP_000177210.1”"（即 https://www.ncbi.nlm.nih.gov/ipg/?term=WP_000177210.1)2. 選擇表的第二列“核苷酸中的 CDS 區域”中的第一條記錄（即“NC_011415.1 1997353-1998831 （-）”，https://www.ncbi.nlm.nih.gov/nuccore/NC_011415.1?from=1997353&to=1998831&strand=2)3. 在此序列名稱下選擇“FASTA”4. 獲取快速序列（即“>NC_011415.1：c1998831-1997353 大腸桿菌 SE11，完全序列法典1. 在“https://www.ncbi.nlm.nih.gov/ipg/”中搜索（例如“WP_000177210.1”"import requestsfrom bs4 import BeautifulSoupurl = "https://www.ncbi.nlm.nih.gov/ipg/"r = requests.get(url, params = "WP_000177210.1")if r.status_code == requests.codes.ok: soup = BeautifulSoup(r.text,"lxml")2. 選擇表的第二列“核苷酸中的 CDS 區域”中的第一條記錄（在本例中為“NC_011415.1 1997353-1998831 （-）”）（即 https://www.ncbi.nlm.nih.gov/nuccore/NC_011415.1?from=1997353&to=1998831&strand=2)# try 1 (wrong)## I tried this first, but it seemed like it only accessed to the first level of the href?!for a in soup.find_all('a', href=True): if (a['href'][:8]) =="/nuccore": print("Found the URL:", a['href'])# try 2 (not sure how to access nested href)## According to the label I saw in the Develop Tools, I think I need to get the href in the following nested structure. However, it didn't work.soup.select("html div #maincontent div div div #ph-ipg div table tbody tr td a")我現在被困在這一步....斷續器這是我第一次處理html格式。這也是我第一次在這里提問。我可能不會很好地表達這個問題。如果有什么問題，請告訴我。
1 回答
慕雪6442864
TA貢獻1812條經驗 獲得超5個贊
在不使用 NCBI 的 REST API 的情況下，
import time
from bs4 import BeautifulSoup
from selenium import webdriver
# Opens a firefox webbrowser for scrapping purposes
browser = webdriver.Firefox(executable_path=r'your\path\geckodriver.exe') # Put your own path here
# Allows you to load a page completely (with all of the JS)
browser.get('https://www.ncbi.nlm.nih.gov/ipg/?term=WP_000177210.1')
# Delay turning the page into a soup in order to collect the newly fetched data
time.sleep(3)
# Creates the soup
soup = BeautifulSoup(browser.page_source, "html")
# Gets all the links by filtering out ones with just '/nuccore' and keeping ones that include '/nuccore'
links = [a['href'] for a in soup.find_all('a', href=True) if '/nuccore' in a['href'] and not a['href'] == '/nuccore']
注意：
你需要包裝硒
你需要安裝壁虎司機
添加回答
舉報
0/150
提交
取消