Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Front-End Testing - SauceLabs / BrowserStack / other...? #63

Open
nelsonic opened this issue Mar 10, 2015 · 20 comments
Open

Front-End Testing - SauceLabs / BrowserStack / other...? #63

nelsonic opened this issue Mar 10, 2015 · 20 comments
Assignees
Labels
discuss Share your constructive thoughts on how to make progress with this issue enhancement New feature or enhancement of existing functionality help wanted If you can help make progress with this issue, please comment! MVP technical A technical issue that requires understanding of the code, infrastructure or dependencies

Comments

@nelsonic
Copy link
Member

Given how simple the MVP UI is going to be, can we build it using basic HTML5 + JS (without any framework) and just focus on the usability for now? To that end I propose that the only Front-End testing we do is https://saucelabs.com/ ... thoughts?

@nelsonic nelsonic added enhancement New feature or enhancement of existing functionality help wanted If you can help make progress with this issue, please comment! discuss Share your constructive thoughts on how to make progress with this issue MVP FrontEnd labels Mar 10, 2015
@iteles
Copy link
Member

iteles commented Mar 10, 2015

Agree that for the MVP stage, HTML5, CSS3 and JS (vanilla or jQuery for conciseness of code) will be more than enough.
Saucelabs seems sensible at this stage as we already know it - unless someone knows of a better alternative? I also have 'look for alternatives to Huxley' on my to-do list as Huxley has now been archived.

@nelsonic nelsonic changed the title Front-End Testing - SauceLabs? Front-End Testing - SauceLabs / BrowserStack / other...? Mar 15, 2015
@nelsonic
Copy link
Member Author

I'm not delighted by the learning curve (for new team members of Selenium in general but specifically SauceLabs) so should we consider BrowserStack: https://www.browserstack.com/automate/node

@nelsonic
Copy link
Member Author

Other options:

@iteles
Copy link
Member

iteles commented Mar 15, 2015

I spent quite a long time last night looking into using PhantomJS with Selenium, using GhostDriver as the driver. The learning curve seems relatively shallow once a step by step of the setup is written and doesn't require grunt like Saucelabs does.

However, it looks like the GhostDriver project hasn't been updated in 5 months so it turns out not a great choice.

@nelsonic
Copy link
Member Author

@iteles were you able to find good examples of tests written for WD ?

@nelsonic
Copy link
Member Author

Sadly, what it comes down to, is that all these testing system have been built by engineers for engineers/QAs and not with humans in mind. Except for eggPlant which uses SenseTalk (which approximates English) for writing tests...
I quite liked using Capybara back in the ruby days, but still thought it was _too complex_ for complete beginners and non-technical people.

there must be a better way

@iteles
Copy link
Member

iteles commented Mar 15, 2015

I haven't found anything simple and especially not really anything with well commented examples. All testing material out there assumes a lot of knowledge already which is terrible for beginners who want to do TDD from day 1.

@nelsonic
Copy link
Member Author

Does this: http://git.io/pjTa read like English...? 😕

@nelsonic
Copy link
Member Author

_BTW_ what do you think of the word Liso ("smooth") for a testing framework?

@iteles
Copy link
Member

iteles commented Mar 15, 2015

Pretty sure it would be Laizoe or Lízoe depending on how proficient they are 😉

@iteles
Copy link
Member

iteles commented Apr 18, 2015

Wow. So not testing was incredibly time consuming. And painful. Testing the same possible bugs manually over and over again every time we made a commit (and there were a lot of commits) is clearly not efficient or particularly effective.
Which means we need to revisit front end testing and make a decision on what we'll use for the next MVP iteration 👍

@nelsonic
Copy link
Member Author

@iteles well _volunteered_!

@oneguy
Copy link

oneguy commented Dec 30, 2016

I know it's been a year since anyone posted, but there are other tools on the market for gui test automation. I've tried most of them, and my favorite is the free zaptest:

@iteles
Copy link
Member

iteles commented Dec 30, 2016

Thanks @oneguy, we'all look into it! Although we're now going to start building this app again in 2017, possibly in Elm, in the meantime we've mostly been using nightwatch, so we wrote this tutorial on it 😊

@oneguy
Copy link

oneguy commented Dec 30, 2016

Cool! I've never heard of Nightwatch before, I'll check it out.. Thanks, @iteles !

@nelsonic
Copy link
Member Author

@oneguy thank you for sharing ZapTest! 👍
What's your experience with using it on a project? 🤔
Was it easy to set up? 💭
Did you use the "Free Edition" or the "Enterprise Editions"?
I cannot see how much it costs for "Enterprise"... do you know?
Also, cannot see if the source is available for modification. (is it "Open Source"...?)

Thanks again!! ❤️

zaptest-home

zaptest-trial-enterprise

zaptest-start-trial

@danielleitcs
Copy link

You might find real user reviews for Sauce Labs, Browserstack and all the other major functional testing tools on IT Central Station to be helpful.

As an example, this user writes in his review of Sauce Labs, "It has made our end to end testing roughly 25 percent faster." You can read the rest of his review here.

@nelsonic
Copy link
Member Author

nelsonic commented Jan 9, 2017

@danielleitcs thanks very much for sharing that link to reviews. ✅

@testingbot
Copy link

If interested, we can offer a free open-source plan - we support Nightwatch testing. Keep up the good work!

@iteles iteles added technical A technical issue that requires understanding of the code, infrastructure or dependencies and removed FrontEnd labels Nov 12, 2019
@laddu1986
Copy link

Hello Dears,
I am looking for a solution of using eggplant functional tests triggered in sauce labs or any other cloud execution environment for execution. Kindly suggest any cloud infrstaucture to use my eggplant functional tests ecxecuted from my eggplant Functional or DAI tool.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discuss Share your constructive thoughts on how to make progress with this issue enhancement New feature or enhancement of existing functionality help wanted If you can help make progress with this issue, please comment! MVP technical A technical issue that requires understanding of the code, infrastructure or dependencies
Projects
None yet
Development

No branches or pull requests

5 participants