scrape.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "['\\nIf they keep it around in next four-five years, I think I will make myself to put on a hazmat suit and visit our friendly Kia dealer (oh, boy are they horrible here, or what) to check it out. It\\'s got a lot of good stuff, but seems like they are still behind on a few things, such as relationship between power and gas mileage (e.g. BMW 340/440 has similar performance, but much better gas mileage as a daily driver), but with appropriate price difference, those objections and shortcomings are not insurmountable. Biggest thing will be the \"first contact\" with a sales person. Hope it won\\'t start from \"are you buying it today?\", \"what can I do to make you take it home?\", or \"let me wash your BMW - oh, I can\\'t find the keys\", \"How about I show you the deal - square one, two, three, four\". ', \"\\nThe lease rate is the factor that stops me cold from taking the leap. Since I don't track my cars, it would do fine for my needs but I would assume an M2 would surpass the Stinger on the track compared to the Giulia. \", \"\\n\\ncirclew said:\\nThe lease rate is the factor that stops me cold from taking the leap.\\nSince I don't track my cars, it would do fine for my needs but I would assume an M2 would surpass the Stinger on the track compared to the Giulia.\\n\\nYes, the completely noncomparable M2 would beat the Stinger on track, as would a corvette or sportbike, BTW. \", \"\\nroadburner said: show previous quotesqbrozen said:Stinger interests me, but not the horrible lease rates.\\nThe Stinger is too big for my tastes, and the transmission overheat issue would also nix it if I wanted to use it as a dual purpose car. For strictly street use I still prefer the Giulia Ti Sport, even though it's a bit on the slow side.I still think my next car will be either an M2 or an M2C.\\nWhy not a Genesis G70 with a manual? \", '\\nAgain, the local dealer are hopeless at best(What can I do to put ya in a car today, pal?)- and with the well know Hyundai proclivity to void warranties at the drop of a hat I could see problems with using it as my instructor car. ', \"\\nroadburner said:Again, the local dealer are hopeless at best(What can I do to put ya in a car today, pal?)- and with the well know Hyundai proclivity to void warranties at the drop of a hat I could see problems with using it as my instructor car.\\nAre you talking about Genesis Dealers or Hyundia dealers? If you go out to the Genesis web site, I think you will see a completely different type of experience. Just like Infiniti, Lexus and Acura changed the way people looked at Asian cars, Genesis dealers aren't Hyundia dealers. Granted there are no Genesis only dealerships yet, but when Rich and I went and looked at a Genesis G80, the treatment was miles a head of what you get at the Kia or Hyundia salespeople. No pressure they weren't looking to be your best friend. Just have to wait for the G70 to show up at the dealers. \", '\\nThanks, but I am more than aware of the distinction. The dealer group that owns the future Genesis store(and the current Hyundai store) has less than a stellar reputation. I suspect that their Genesis sales \"experience\" would still require me to take a long hot shower afterwards. Not worth my time. ', '\\nroadburner said:Thanks, but I am more than aware of the distinction. The dealer group that owns the future Genesis store(and the current Hyundai store) has less than a stellar reputation. I suspect that their Genesis sales \"experience\" would still require me to take a long hot shower afterwards. Not worth my time.\\nYeah, I went once to an AutoNation Lexus store. It had nice decor and everything, but the experience wasn’t the same as my local BMW dealer. It was polite, but you could still feel primary focus on sale and closing, not the product exposition and its potential fit into your life, which I felt at BMW, Audi, or even Volvo stores, every time I visited those. Something you expect at a good Toyota dealership. The difference is subtle, but perceptable. It’s mostly in the types of conversations you have with the salesman, or the manager, if he/she introduces themselves. After the visit I even received generic template follow up emails from two different managers, even though I made it clear to the sales guy the product was not interesting to me (I was looking at CT200h and it was a total dog, real disappointment). To their credit, when I responded to them saying don’t call/write and explained why, they left me alone. ', \"\\nI am the poster formerly known as benjaminh and now as benjaminhf. Just wanted to say I'm still alive, but my 17 year history with Edmunds has seemingly been erased. Also I've been very busy with work. But I wanted to briefly say that I'm still really enjoying the driving experience with my leased 2018 Acura TLX 2.4 Tech. Great car for the money imho. All best wishes out there to the chronic car buyers, etc. @stickguy: are you still considering a TLX? \", '\\n Still on the list. Just have not been looking actively right now. ', \"\\nbenjaminhf said:I am the poster formerly known as benjaminh and now as benjaminhf. Just wanted to say I'm still alive, but my 17 year history with Edmunds has seemingly been erased. Also I've been very busy with work. But I wanted to briefly say that I'm still really enjoying the driving experience with my leased 2018 Acura TLX 2.4 Tech. Great car for the money imho. All best wishes out there to the chronic car buyers, etc. @stickguy: are you still considering a TLX? \\nI sent you a message \", \"\\nA new and mostly positive review by Kelly Blue Book of the TLX. The reviewer says the TLX is likely to be more reliable than some other luxury cars in the long run, which is good news for me since I'm hoping to keep mine for quite a while.... \", '\\nIf I do manage to upgrade to a TLX it would have to be with a 10 year horizon.That was the deal the wife made to get the RDX. that just had its 6th anniversary last week, and sitting at about 48,000 miles. Though getting used more now. Wife just started a new job Monday, with a 27 mile RT commute. Going to wear the poor thing out. Another reason for me to upgrade. Get something she can share for commuting duty. ', \"\\nkyfdx said: show previous quotesbenjaminhf said:I am the poster formerly known as benjaminh and now as benjaminhf. Just wanted to say I'm still alive, but my 17 year history with Edmunds has seemingly been erased. Also I've been very busy with work. But I wanted to briefly say that I'm still really enjoying the driving experience with my leased 2018 Acura TLX 2.4 Tech. Great car for the money imho. All best wishes out there to the chronic car buyers, etc. @stickguy: are you still considering a TLX? \\nI sent you a message\\nThanks. I'll give it a try at some point to merge my accounts. \", \"\\nstickguy said:If I do manage to upgrade to a TLX it would have to be with a 10 year horizon.That was the deal the wife made to get the RDX. that just had its 6th anniversary last week, and sitting at about 48,000 miles. Though getting used more now. Wife just started a new job Monday, with a 27 mile RT commute. Going to wear the poor thing out. Another reason for me to upgrade. Get something she can share for commuting duty.\\nI'm not sure if I'd have the patience and discipline to really keep a car for ten years—maybe eight?—but if I did this TLX would be the car for that. So far I really like the TLX on all levels—driving dynamics, comfort, awesome sound system, looks. It's by far the best car I've ever had. And given that it's an Acura I can see potentially driving it past the standard 70,000 mile engine and transmission warranty.Not surprisingly it seems like the incentives on the 2019s are less than what was available over the summer for the 2018s. Maybe even by Thanksgiving the lease incentives might be higher again? \", '\\nThey usually go up as the year goes along. Christmas ind Presidents’ Day are good options.I try and stagger the cars, so always at least one newer. Also helps to only have one loan at a time, max. ', \"\\nYeah, I was and am a bit concerned with getting two new cars at once. But so far we haven't regretted it. The CR-V is also an awesome vehicle. We love it for what it can do in terms of large cargo space while still carrying passengers. We use that a lot, actually. And the CR-V is also fun to drive. Anyway, we put an extra 4k down on our the 15k loan we have for the CR-V, and so now the amount owed on it is down to 11k. If we can make another 4k extra in Dec., which might be possible, and then yet another 4k extra early next summer, that along with our monthly payments might get us free and clear on the CR-V by July or so. Then we'll just have the reasonable $229 a month lease on the TLX. \", '\\nThe KBB reviewer makes some good points about the infotainment system on the TLX. As he says, it\\'s not intuitive at first, but over time it becomes pretty good. And I\\'m now used to it and can use it pretty easily. My wife\\'s new CR-V has just the touchscreen, and in some ways I prefer that, but believe it or not in other ways I prefer the TLX\\'s 2-screen system. Let me try to briefly explain. So with the one touchscreen like with the CR-V—and many new vehicles these days—you are either in one display mode or another for the screen. In other words, if you\\'ve called up the stereo controls on the screen, then the map you might be using from AndroidAuto or CarPlay goes away. Same with the climate controls on the CR-V. With the system on the TLX, however, you can have two things going on at the same time. And so your navi screen at the top (which is a good place for it, right below the line of sight outward) can be doing its thing directing you to where you need to go, while the lower screen on the TLX is displaying your stereo and climate controls. Plus the touch screens, to state the obvious, are magnets for dust and fingerprints, and since you don\\'t touch the upper screen on the TLX it stays pristine. Finally, the TLX\\'s touch screen is more responsive than the one on the CR-V. Sometimes you need to press an electronic \"button\" on the CR-V\\'s screen twice to activate it, while one gentle touch on the TLX\\'s screen almost always works the first time.In terms of handling, even my wife has said she really likes the way the TLX drives. She likes the 4-wheel steering (although it took her a couple of months to actually feel it), the handling, and the smooth power. ', '\\nI like the 2 screen set up, for just the reason you said. More real estate, and dedicated map when needed. ', '\\nMy local Cadillac dealer has their last ATS available for lease for $200 a month with \"0 down\": \"2018 CADILLAC ATS Sedan 2.0t STDLease For$199/MO $0 DOWN\"https://www.courtesycadillac.net/MonthlySpecialsQuite the deal for that car imho. ', '\\nI would take it. without even looking at the link! ', '\\nThat dealer has the same GM as my BMW dealer- the guy that ran off all but two of the BMW salespeople and added dealer packs and a high doc fee. ', '\\nThe fine lrint for all says \"plus dealer add-ons.\" Oh boy.But, all else being equal, I\\'d probably take the XT5 for $30 more.\\xa0 ', '\\nThe CTS looks like a smokin’n deal if your name is not @graphicguy. So is the XT5, although I understand it’s a slug. ', '\\nso the car is $199/month, and the mop and glow stuff is another $175? ', '\\nqbrozen said:The fine lrint for all says \"plus dealer add-ons.\" Oh boy.But, all else being equal, I\\'d probably take the XT5 for $30 more.\\xa0\\nIf I was 25 years older I might an XT5 as well. ', '\\n\\ncarnaught said:\\nThe CTS looks like a smokin’n deal if your name is not @graphicguy. So is the XT5, although I understand it’s a slug.\\n\\nIts a hard knock life when 0-60 in 6.5 secs in an SUV is called \"a slug.\" ', '\\nWell, the translation for \"slug\" could be this: ', \"\\nWait... an SUV doesn't handle like a sedan?! Good thing we have reporters to bust scandals like this wide open!;b \", \"\\nI wouldn't call the XT5 I had as a loaner a slug by any means, but I didn't like it much. Felt big, heavy, and it had that awful BMW-style beer-tap gearshift which I hated. \"]\n"
     ]
    }
   ],
   "source": [
    "from selenium import webdriver\n",
    "from bs4 import BeautifulSoup\n",
    "import pandas as pd\n",
    "driver = webdriver.Chrome(r\"C://DRIVERS//chromedriver\")\n",
    "driver.get(\"https://forums.edmunds.com/discussion/2864/general/x/entry-level-luxury-performance-sedans/p702\")\n",
    "content = driver.page_source\n",
    "soup = BeautifulSoup(content)\n",
    "comment=[]\n",
    "for a in soup.findAll('div', attrs={'class':'Item-BodyWrap'}):\n",
    "    name=a.find('div', attrs={'class':'Message userContent'})\n",
    "    comment.append(name.text)\n",
    "print(comment)\n",
    "df = pd.DataFrame({'Comments':comment}) \n",
    "df.to_csv('scrapData.csv', index=False, encoding='utf-8')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}