View Full Version : Andymark Beta Testing Log
daniel_dsouza
14-11-2013, 00:09
I signed up for AndyMark beta testing a week or so ago, and received this email today.
Daniel D'Souza,
Thank you for signing up to help us Beta Test this years FIRST Choice website. It will be open on November 19th at 12pm EST.
Your login and password will be found at the bottom of this e-mail. And the URL for beta testing will be sent out the morning of Tuesday (November 19th).
A few things about Beta testing:
* The Password you are given below is NOT the one you will use after Beta testing
* All parts listed are only examples from last years products
* Credits for these products do not reflect this years tbd Credits
* Qty available and max qty does not reflect this years tbd availability and max
* You will not actually get any of these products, this is only a test
* Please select COD for payment method during checkout
* You can make many orders to fulfill your credits, or one order, it's up to you
* Don't be afraid to try to mess something up
* Explore as much as possible to find errors
* Your login may not be your team number, this is fine for Beta testing
Please fill out this survey after/during testing to help us fix bugs that may have been found:
http://bit.ly/*******
If you have any questions, feel free to e-mail us at FIRSTchoice@andymark.com.
Login: ****
Password: ********
I'll be posting my experiences here on CD. It looks like I'll have to wait until Saturday to try this out.
Who else is psyched for AndyMark Beta testing? Please comment with your experiences as well. It's great to see a great company doing great things to improve their great services for great programs like FIRST.
Andy Baker
14-11-2013, 08:54
Daniel,
Thank you for starting this thread and posting your findings here. We are excited to see what will come of all of this testing.
Sincerely,
Andy Baker
Jon Stratis
14-11-2013, 09:26
I got the same e-mail, and I'll certainly be posting my thoughts as well. Before we get into results though, it's important to remind everyone that the purpose of this beta test is to find issues with the system so they can be fixed before the real event. So if we happen to find a small problem or two, don't freak out! Personally, I'll be a little disappointed if I can't manage to break something... after all, that is part of my regular day job! :p
Yes let's make Jerry pull his hair out. Oh wait.....
I signed up for AndyMark beta testing a week or so ago, and received this email today.
I'll be posting my experiences here on CD. It looks like I'll have to wait until Saturday to try this out.
Who else is psyched for AndyMark Beta testing? Please comment with your experiences as well. It's great to see a great company doing great things to improve their great services for great programs like FIRST.
Testing starts on Tuesday, or am I missing something?
As one of last year's complainers, I was happy to sign up to help with this testing. As a "beta test" I assume its purpose is to uncover remaining problems in a limited audience so they can be fixed, so I don't plan to "report" on any of the experience. Anything I experience in the test, good or bad, may or may not be in the final product, so I would see no point in reporting on it and risk sparking rumors that might not be accurate. I just assume that is an obligation I take when I agree to help test.
Personally, I'll be a little disappointed if I can't manage to break something
Same here. Gonna try everything, even things that would make no sense for people to do.
As one of last year's complainers, I was happy to sign up to help with this testing. As a "beta test" I assume its purpose is to uncover remaining problems in a limited audience so they can be fixed, so I don't plan to "report" on any of the experience. Anything I experience in the test, good or bad, may or may not be in the final product, so I would see no point in reporting on it and risk sparking rumors that might not be accurate. I just assume that is an obligation I take when I agree to help test.
+1
C_Morgan
14-11-2013, 12:31
As the FIRST Choice Order Placer for the past few years, I look forward to participating in the Beta testing on behalf of FRC862: Lightning Robotics.
+1 for the continuous improvement approach
I plan to use the PSR [Problem Steps Recorder] tool built in to Win 7 during my testing to capture any errors which I may come across.
Jimmy Nichols
15-11-2013, 07:36
Looking forward to breaking something or at least trying to. I have had relatively good experience with FIRST choice, despite having been caught in the opening day issues last year and being able to order parts that had already been sold out.
Looking forward ...
ah ha!
DonRotolo
15-11-2013, 21:47
As one of last year's complainers, I was happy to sign up to help with this testing. As a "beta test" I assume its purpose is to uncover remaining problems in a limited audience so they can be fixed, so I don't plan to "report" on any of the experience. Anything I experience in the test, good or bad, may or may not be in the final product, so I would see no point in reporting on it and risk sparking rumors that might not be accurate. I just assume that is an obligation I take when I agree to help test.
Maybe I am missing something here: If you find a problem, you're going to say something to someone, right? Otherwise, what's the value of your efforts? The goal is to find problems and tell them (AndyMark) about them so they can be fixed.
BBray_T1296
15-11-2013, 22:00
Maybe I am missing something here: If you find a problem, you're going to say something to someone, right? Otherwise, what's the value of your efforts? The goal is to find problems and tell them (AndyMark) about them so they can be fixed.
He means here on Chief Delphi to all of us non-betatesters
I think Mr. Spatz means publicly call AndyMark out about their errors (IE say something bad about FIRST choice on this particular thread for people to read and assume will be a big problem come ordering time.)
nicholsjj
19-11-2013, 10:20
First update from beta testing today is that FIRST Choice is now a unique website. https://www.firstchoicebyandymark.com/en/login?returnurl=%2f T at first glance through the website it appears to be much more user friendly that the last one. Also the credits per part look much better as well.
wilsonmw04
19-11-2013, 10:28
First update from beta testing today is that FIRST Choice is now a unique website. https://www.firstchoicebyandymark.com/en/login?returnurl=%2f T at first glance through the website it appears to be much more user friendly that the last one. Also the credits per part look much better as well.
remember, when looking at this TEST website, the rules are made up and the points don't matter.
In other words:You should not read anything into what you see on the site. The parts you see here may not be legal and the credits may not reflex their actual value.
C_Morgan
19-11-2013, 10:46
Even if you did not sign up for FIRST Choice Beta testing, the intention of sharing the link is to help generate more traffic on the server once the noon testing commences.
markmcgary
19-11-2013, 10:53
I plan to use the PSR [Problem Steps Recorder] tool built in to Win 7 during my testing to capture any errors which I may come across.
I learn something new every day. Thanks.
Jon Stratis
19-11-2013, 11:13
Spent the past 15 minutes poking around the site, and I have to say... it's extremely nice! So far, I can tell everyone:
Browser support:
The site appears to work equally well in IE 6, 7, 8, and 9, Firefox 25, Chrome 31, Safari for iPhone(most recent version), and Chrome for iPhone (most recent version). I do NOT recommend using it on the iPhone, however, as what I'm seeing has not been optimized for mobile displays. I don't expect this will be an issue for most people, though. Just use a real computer.
In terms of finding issues, I've only noted two issues so far, and they are pretty minor, not hindering ordering any parts. Honestly, most people probably wouldn't even notice/think about them.
Steven Donow
19-11-2013, 11:18
First update from beta testing today is that FIRST Choice is now a unique website. https://www.firstchoicebyandymark.com/en/login?returnurl=%2f T at first glance through the website it appears to be much more user friendly that the last one. Also the credits per part look much better as well.
Agree with this, and an added note from the email:
Even if you're not in the beta test, PLEASE PLEASE PLEASE go to this site anyway at noon, the email says the more traffic at noon, the better.
The one thing I don't like is I can't view all items in one list, and the default items per page is 4. Otherwise, nothing seems broken yet.
Wetzel
South Sudan is not on the list of countries for the addresses. Yes, that is the only thing I have been able to find wrong yet.
I got a bunch of saws and two talons. :D The system moved through OK, and the quantity available and on hold seemed to be updating correctly.
My one problem was that the shopping cart timer does not increment as you move through the checkout process, it counts down from 2:15 from when the last item was placed in the cart. My first order timed out as I was reviewing the order confirmation screen, and it emptied my cart. Might want that timer to either 1) be longer or 2) reset on more actions, like clicking checkout or as you proceed through the checkout options.
Wetzel
otherguy
19-11-2013, 12:09
It looks like I can keep parts in my cart forever by just clicking "update shopping cart" link every two minutes without making any changes to quantities or anything.
otherguy
19-11-2013, 12:12
My one problem was that the shopping cart timer does not increment as you move through the checkout process.
This. Slow internets here. I wasn't able to check out before cart expired.
Pjohn1959
19-11-2013, 12:23
What I reported back to AndyMark:
I did not receive an email that show the number of points that I was supposed to get. I was only aware that it was live after checking the Chief Delphi thread.
Some of the items, when clicked on to add to cart, took me to another screen, to add it to the cart. It was somewhat difficult to return to the order screen, and took away precious order time. If this was real, I'm sure I would have missed out on some of the opportunities because they go fast.
I was also timed out during the checkout procedure. It takes longer that the 2 minutes to type up all the information that was requested. I don't know how that would have affected my order.
Jimmy Nichols
19-11-2013, 12:24
It looks like I can keep parts in my cart forever by just clicking "update shopping cart" link every two minutes without making any changes to quantities or anything.
Same here or changing the quantities and hitting enter does the same.
I managed to get out of stock saws into my cart. They were available when I added them, then went out of stock at some point most of the way through the checkout. I went out of the checkout screen, and then it will no longer let me begin the checkout process with the saws in my cart, but does not give me an error message telling me why it doesn't do anything when I click "Checkout".
Whilst working on this, the cart timer expired and everything was removed. The joystick that was also in the cart has now been claimed by someone else.
-"Preview" is not an intuitive choice for "browse" or "shop"
-It would be nice to be able to save shipping address type as part of the address.
-The only way to check points available was to view the cart after items were placed in it. I could not find a point balance prior to adding items to the cart.
-I don't know if this is a beta test feature, but after every order it reset my point total to 100.
Wetzel
Jimmy Nichols
19-11-2013, 12:28
My feed back below.
1.Before Noon I clicked repeatedly on add to cart on several items in a row. Every 2nd or third click on a separate item would cause it to go to the items page. For example, I click add to cart on joystick and then classmate immediately after and the product overview page for the joystick opens.
2.Before Noon some items I can double click add to cart and it redirects to the product over view page. Classmate does this for example, but the compressor doesn't.
3.Clicked to add talon from preview page and takes me to the product overview for the talon and does not add to shopping cart. Same happens to all Controls items except the Sidecar
4.Received warning that shopping cart was going to empty but it didn't empty, just restarted the timer.
5.Every time I changed quantities or click update shopping cart, the timer resets to 2:14
6.I was able to place 3 orders one for 54 points, 1 for 94 points, and 1 for 97. Since orders are pending, I still have full 100 credits available. Order numbers 54, 94, and 149.
Jon Stratis
19-11-2013, 12:28
Anybody else try doing multiple orders yet? I have:
Order number 100:
photoswitch (1)
Talon (2)
Joystick (1)
CIM (6)
DSC (2) Compressor (1)
Order number 161:
Classmate (1)
Servo (3)
Photoswitch (5
CIM (5)
DSC (2)
Order number 166:
CIM (20)
for a total of 281 points spent so far. It doesn't seem to be subtracting points when I complete my order.
otherguy
19-11-2013, 12:35
The shopping cart timer does not decrement if you close your web browser tab.
-Fill cart
-Note cart time and close tab
-wait a minute
-reload AM FC page
-everything's still there, and the cart timer hasn't decremented.
The more I test this one, the more it seems like maybe the cart time being shown is just incorrect, and that it may actually be decrementing server side... needs further attention to narrow down what's going on.
Also, It would be nice if there was a way to view only products that are in stock.
I have managed to successfully order at least 80 photosensors now and counting by placing multiple orders. I have spent over 600 points on my orders. Maybe this is a game hint that the match time is unlimited! :D
I have now managed to single-handedly deplete the stock of PG27 GearMotors. This should be interesting come the actual opening date.
Jon Stratis
19-11-2013, 12:45
No, the shopping cart timer of 2:15 indicates the same match time as normal. However, with the way points can be racked up, I think it means game pieces will be recycled back into play, leaving us with no real maximum points possible this year!
The shopping cart timer does not decrement if you close your web browser tab.
-Fill cart
-Note cart time and close tab
-wait a minute
-reload AM FC page
-everything's still there, and the cart timer hasn't decremented.
The more I test this one, the more it seems like maybe the cart time being shown is just incorrect, and that it may actually be decrementing server side... needs further attention to narrow down what's going on.
Also, It would be nice if there was a way to view only products that are in stock.
I saw this as well, except when I went to the shopping cart after logging back in, the timer went to zero and the cart was gone.
Reported to beta survey
Anybody else try doing multiple orders yet? I have:
Order number 100:
photoswitch (1)
Talon (2)
Joystick (1)
CIM (6)
DSC (2) Compressor (1)
Order number 161:
Classmate (1)
Servo (3)
Photoswitch (5
CIM (5)
DSC (2)
Order number 166:
CIM (20)
for a total of 281 points spent so far. It doesn't seem to be subtracting points when I complete my order.
I completed like 6 orders in the span of 9 minutes. Orders 20, 32, 46, 117, 125, and 131. In total, these add up to:
46 CIMs, 2 Talons, a Classmate, an 8 slot cRio, a Joystick, 3 sidecars, 3 compressors, 26 Photoswitches, a Right Angle Drill kit, and a Circular Saw.
That is what 494 FIRST Choice parts will buy, provided you can get access to that many points and pay for the shipping. I don't even want to talk about how much I got "charged" for FedEx Priority Overnight. :rolleyes:
On a side note, it did keep track of previous orders; ie I was unable to order another cRio in subsequent orders, so it does keep track of quantity per customer limited items.
Over the course of around 30 minutes or so, between taking notes in class, I managed to rack up:
173 gearmotors
140 Photosensors
1 Right Angle Drill Kits
2 Talons
1 Classmate
1 cRIO
1 Servo
1 DSC
1 Compressor
1 CIM
8 Circular Saws
and around $4,105.87 in overnight priority shipping. :D
DonRotolo
19-11-2013, 20:10
He means here on Chief Delphi to all of us non-betatestersI think Mr. Spatz means publicly call AndyMark out about their errors (IE say something bad about FIRST choice on this particular thread for people to read and assume will be a big problem come ordering time.) Ah, yes, I was clearly missing something there. Thanks.
I placed a few orders, no fatal or hard errors, a few minor quibbles and minor buggies. I did manage to score a pile of stuff though ;-)
vBulletin® v3.6.4, Copyright ©2000-2017, Jelsoft Enterprises Ltd.